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FOREWORD 


The preliminary work for the series of studies here summarized was done 
while the senior author was assistant director in charge of supervision, Detroit 
Public Schools, 1920-24. Two concepts arose from this experience: First, 
competent observers observing the same teacher simultaneously may disagree 
upon the quality of the teaching observed; and second, the subjective impres- 
sionistic vocabulary with which teaching is evaluated might be objectified by 
defining teaching in terms of observable teacher and pupil behaviors and con- 
ditions. Between 1924-30 a series of investigations was conducted to test these 
hypotheses. Three conclusions were drawn from these early studies: 


1. The fact that two or more observers observing the same teacher 
simultaneously may disagree in the quality of teaching observed 
was reaffirmed; 

2. Good teachers cannot be separated from poor teachers in terms 
of specific teacher behaviors (there is an appropriateness aspect 
to teacher behaviors that must be taken into consideration); and 

3. The evaluation of teaching can be objectified through the use of 
teacher and pupil behaviors and operational definitions of the per- 
sonal and professional prerequisites to teacher effectiveness. 


The subsequent years, 1940-60, have been employed in exploring ways and 
means of validating an objective approachto teacher evaluation, Many differ- 
ent approaches have been explored and many different data-gathering devices 
employed: measures of pupil growth and achievement; tests of qualities thought 
to be associated with teacher effectiveness and all sorts of rating scales; studies 
of teacher and pupil behaviors and interrelationships; andtests of basic knowl- 
edges, attitudes, and skills. 

Many persons have assisted with these studies. The seventy-five or more 
doctoral studies here summarized represent many hours of careful work on the 
part of the persons making these studies. Participating in these studies were 
many teachers, Supervisors, and superintendents who gave freely of their 
time and effort, andmany members of the staff of the Department of Education 
have served on advisory committees. The Graduate School and the Schoo} of 
Education of the University of Wisconsin have given almost continuous financial 
support to these studies. The summary here presented has been made possi- 
ble through financial assistance provided by the Graduate School ofthe Univer- 
sity of Wisconsin and the personal assistance provided by colleagues and others 
as indicated by the personnel herewith listed. To these and all others who 
have assisted with these investigations I give my sincere thanks. 


A. S. Barr 
April 17, 1961 
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CHAPTERI 


THE NATURE OF THE PROBLEM* 


A. S. BARR 


To select, recruit, educate, and assign 
teachers to particular teaching positions in an ac- 
ceptable manner, one must have more precise in- 
formation about the many meanings associated 
with teaching, in general, and in particular situ- 
ations; and how to identify the personal, academ- 
ic and professional prerequisites to effective- 
ness. 

Part of the difficulty associated with the de- 
velopment of anadequate program for the meas- 
urement and prediction of teacher effectiveness 
arises from the facts that teaching means many 
different things, that the teaching act varies from 
person to person, and from situation to situation, 
Teachers teach different subjects and at differ- 
ent grade levels, they may not teach subjects but 
direct activities; besides classroom instruction 
they are presumed to be friends and counselors 
of students, members of a school community, 
and members of various local, state, and national 
associations of professional workers. With the 
situation as it is, the researchers interested in 
the measurement and prediction of teacher effec- 
tiveness have basically two choices: one, to seek 
the essence of teaching found within a wide range 
of activities called teaching and the means of 
predicting efficiency ina variety of situations; or 
second, to measure efficiency in particular learn- 
ing and teaching situations and predict these par- 
ticular efficiencies. These particular situations 
may be carefully controlled situations as found in 
experimental research or the uncontrolled situ- 
ations of particular schools, classes, and school 
Systems. The first problem is one of definition; 
one must define teaching genes it can be evalu- 

iveness predicted. 

ap NE EN аи arises out of the З = 
the concept of efficiency is nowhere well defined. 
Here as with the definition of teaching a are 
many different concepts of efficiency. e edem 
ions are so varied among teacher educators, 
administrators, and teachers that each person 
can be said to have a more or less private Sys- 
tem of evaluation all of his own. This is not a 
mere statement of opinion but a matter that has 
been amply substantiated by research. me 
amount of divergence that one would expect to fin 


in a particular situation would depend, of course, 
upon the composition of the group making the 
evaluation, the extent towhich an attempt has been 
made to standardize criteria and provide training 
in their use and the particular teacher or aspect 
of teaching being evaluated. In uncontrolled sit- 
uations the judgments of a group of supervisors, 
administrators, and teacher educators, all ob- 
serving the sameteacher at the same time, under 
identical conditions, may vary so much that some 
observers may rate a particular teacher as 
among the very best that they have observed and 
others as among the very worst teachers that they 
have observed. Much that is important in pro- 
viding good schools depends upon the accur acy 
with which teachers are evaluated. 

There are many predictions made in the 
course of selecting and recruiting persons to be 
trained asteachers, in the education of teachers, 
and in the placement and employment of teachers, 
Many persons have failed to realize that so many 
predictions are made inthe procurement and man- 
agement of the teaching personnel. When admis- 
sion standards are set in teacher educating insti- 
tutions, in effect a prediction is made, namely, 
that persons meeting these standards do have the 
potential to be good teachers; when curricula are 
established for the education of teachers, a pre- 
diction is made, namely, that persons who pursue 
these curricula will become good teachers; when 
the superintendent employs an experienced or in- 
experienced teacher, he assumes, or at least 
hopes, that she will succeed. The employment 
score for some administrators is not very high 
in this respect. 

The problem under discussion involves many 
psychological considerations. First of all, at- 
tempts to measure and predict teacher efficiency 
make assumptions relative tothe nature of human 
abilities. As one examines the literature, it can 
readily be observed that human abilities have 
taken on many meanings. Sometimes they are 
thought of as physical processes and sometimes 
as symbolical processes. Sometimes they are 
referred to as psycho-physical entities and some- 
times as operations. They are sometimes con- 
sidered as something very specific such as the 


*This summary has been made possible througha grant from the Graduate School, University of Wisconsin, 
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ability to read the temperature from a very sen- 
sitive thermometer or as something very general 
such as the ability to do certain types of mathe- 
matical calculations. Sometimes they are spoken 
of inevenmore generaltermsas when one speaks 
of academic intelligence, mechanical intelligence, 
or social intelligence. Sometimes abilities are 
referred to as primary and sometimes as secon- 
dary; sometimes as deep and underlying opera- 
tions and sometimes as easily observed surface 
or superficial events. We shall look upon all 
such use of the term as matters of convenience 
but shall at all times attempt to keep the reader 
informed about the meaning intended. 

The nature of human abilities cannot be ade- 
quately defined without some reference to the 
mind-body relationship. We shall assume that 
mind and body are one and discuss teaching effec- 
tiveness, chiefly, interms 1) of operations, pro- 
cesses, and behaviors, 2) of conditions, internal 
and external, considered essential to easy, 
smooth, and efficient operations, and 3) of end 
products, outcomes and results, that follow from 
operations. When words like intelligence, tact, 
forcefulness, forthrightness or cooperation are 
used, they will, in general, be used to describe 
behavior rather than innate qualities or traits. 
The conditions, both external and internal, under 
which teaching takes place will be treated as far 
as possible on a factual basis and in a manner 
Such as to include both psycho-physical processes 
and socio-physical environment factors and their 
many interrelationships. 

The above very general statement may be 
rendered Somewhat more meaningfulby a further 
discussion of certain aspects of the problem. 
Consider, for example, the personal internal con- 
dition essential to efficient operations so gener- 
ally lost sight of inteacher efficiency studies. 
Proper physiological functioning, including sen- 
Sory processes, neurological processes, circu- 
latory processes, digestive processes, excretory 
processes, and glandular processes, is assumed 
to constitute a basic source of conditions that 
limit and facilitate efficiency inteaching. The 
psychologists are not ordinarily directly con- 
cerned withthese but they are nonetheless impor- 
tant and need much more consideration than they 
ordinarily receive. They constitute, doubtlessly, 
the most important single source of causes of effi- 
ciency and inefficiency in teaching. These proces- 
ses underlie many of the causes of effective and in- 
effective teaching frequently discussed at a more 
superficiallevelby psychologists and in a manner 
that may be quite abstract and ambiguous. 

In this connection, a point should be made of 
the fact that many persons interested in effective 
classroom instruction will not be content to 
merely study behavior. Much can be learned 
from the study of behavior and as a psychological 
operation it certainly is a vast improvement over 


the study of the stream of consciousness which 
characterized psychology at the turn of the cen- 
tury. Many will desire, however, to know how 
behaviors come to be, their concomitants, and 
antecedents. Much of tne current theorizing about 
behavior and other psychological uncertainties 
arises out of the unwillingness of many psychol- 
ogists to look beyond and back of events. The 
point here is that much can be learned about m 
er efficiency from the study of psycho-physica 
rocesses. 

I Another critical point inthe study of human 
abilities will be found in the sensory processo 
and perception. Much attention was given to "s 
testing of the sensory processes at the turn of = 
century in attempts to measure intelligence * 
not with too much success. Those studying n 
matter didfindout, however, that individuals dif- 
fered, and laid the basis for further [уез аш. 
As the matter has been pursued further, and wi 
better investigational procedures, much new in- 
formation hasbeen had. Among tne broader gen- 
eralizations that have arisen from this study is 
the concept of early learning. In a certain vem 
Sensory perceptions are learned and much Een 
wili condition human behavior and efficiency wi 
be learned in the first few years after birth an 
during the pre-school period. The nature al ү 
functioning of perception needs careful study = 
relates to teacher efficiency. In a more comp "e 
and more highly generalized level, fruitful s 
search has already been conducted with referen 4 
to such matters as social perception, self perceP, 
tion, and the teacher's perception of all sorts 
teaching situations. This would appear (0 E 
closely related to any basic attack upon the mea 
urement and prediction of teacher efficiency. — 

Another critical point in human behavior al 
efficiency will be found in the ties that have bee! 
established between physical and symbolic man Es 
ulation in each individual teacher’s way of thinkin’ 
and behavior. The building of these connection 
comes chiefly in preschool and early elementary 
school education. This being as it is, the matte” 
has been generally looked upon as water over th^ 
dam and not amenable to further study and x 
Provement. But, presumably, the connection р 
tween the physical world and the symbolic wor 
is faulty or inadequate in many instances. Many 
people live in a world of symbols that have little 
connection with the realities of life. As а matter 
of fact, muchof the discussion of teaching is quite 
remote. Possibly a study of just how teachers 
perceive the many things associated with teach- 
ing, the concepts that they hold, and their ability 
to manipulate verbal symbols might provide neW 
insights into teacher efficiency. Teaching involves 
an immense amount of verbalization. 

In the immediately preceding discussion, at- 
tention has been focused upon the antecedents 0 
teacher efficiency. The researcher who purports 


to assess human abilities must be equipped not 
merely with lists of the conc omitants of ability 
but he must have ideas about how these are cate- 
gorized andstructured. Oneof the theories about 
structure is that ability can be thought ofas 
some general power (Spearman called this gen- 
eral factor g) plus a host of special capabilities. 
Other theories emphasize the importance of group 
factors. Thurstone, for example, stresses the 
importance of what he called the primary mental 
abilities. The manner in which he structured 
these abilities, useful as it seemed to be for cer- 
tain purposes, may or may not be helpful for the 
evaluation and the prediction of teacher effective- 
ness. Much has also been said about the dimen- 
sions of abilities. Thorndike, for example, em- 
phasized the dimensions of breadth and depth. 
Guilford has pursued this matter intensely for 
many years and has suggested a much more elab- 
orate structure. It would seem that the re- 
searcher in this area must give some consider- 
ation to structure. : 
More use should be made of ps yc hological 
theory. It is an important source of ideas about 
teaching ability and competency, but the other side 
of the coin is equally important, that is what is 
done must be workable, practical, or useful 
in a situation composed of many factors 
other than psychological theory. Besides the 
skepticism that many practitioners have of psy- 
chologists and their theories, there is the need 
that theory be set forthwith more objectivity, and 
ina manner that is more meaningful to practi- 
tioners. For one thing, theory must be simpli- 
fied; this usually comes with moreinsight. What 
is frequently lost sight of is that theory by its 
very nature tends to emphasize the generalizable 
and to neglect the specifics. Practitioners are 
seldom allowed to forg et specifics. The re- 
searchers involved in the investigations here sum- 
marized would appear to be generally familiar 
with the theories of the structure of human abil- 
ities but their specific assumptions inthis re- 
spect are frequently inadequately set forth. | 
Even when one is С lear about the various 
izi d structuring human abil- 
ways of categorizing and 9 n 
bularies may be employed in 


ities, different voca š 
talking about the matter. This would appear to 


be particularly true of the discussions af шь v 
cial talents presumed to be prerequist ге bre 
ferent teaching assignments, ae digs of 
teach many different things under a ales 7 It 
conditions to pupils with different capacities. | 

is not generally assumed that the T petal I 
required of teachers are possesse = y 
amounts by any particular teacher Or t venena 
are highly intercorrelated. This latter poin E 
comes exceedingly important in cor nelation'stud- 
ies where traditionally low correlations are gen- 
erally assumed to be undesirable. At various 
places inthe discussion to follow, a point will be 
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ficiency that one must expect. 


made of the fact that correlations cannot be taken 
at face value. At this point it is emphasized that 
the talents of individuals are highly diversified 
and that it is doubtlessly psychologically unsound 
to expect many high level talents in any particu- 
lar individual or that they will be highly intercor- 
related. Itis probably sound to assume that there 
is a considerable number of one-talent teachers. 
There is a lesser number of two-talent teachers; 
and very tew many-talented teachers. In light of 
current theories of the structure of human abili- 
ties, itis probably best to hypothesize that teach- 
ing ability is composed of some particular com- 
binations of special and general abilities. Much 
of the research relativetothe evaluation and pre- 
diction of teacher effectiveness does not seem to 
reflect this point of view to any considerable ex- 
tent. 

Besides the foregoing problems there are the 
discrepancies between potential and observed ef- 
For many reasons 
many individuals do not live up to expectancy. 
These discrepancies may arise from many rea- 
sons: lack ofinterest іп pupils, teaching, and the 
subjects taught; lack of physical energy, deter- 
mination and drive; lack of adaptability, flexibil- 
ity, or the ability to adjust to different needs, 
persons, and situations; personality conflicts, 
rigid value systems, and attitudes unacceptable 
to majority groups: teachers, parents, pupils, 
administrators, supervisors and allothers with 
whom the teacher may come in contact. These 
deal chiefly withthe feeling components of behav- 
ior andare partofthe potential except that meas- 
ures of potential have dealt chiefly with its cog- 
nitive aspects. Since, for various reasons, 
people do not live up to expectations, those who 
would predict efficiency must include in their 
machinery of prediction some of the non-static 
aspects of behavior. 

Possibly some thought should also be given 
to the nature of measurement. Measurement is 
a device for eliciting behaviors under standard 
conditions. Mostofthe behaviors studied through 
the so-called standardizedtest are verbal behav- 
iors and while teaching may be studied by means 
of direct observation, measurement is frequently 
nothing more or less than the counting of the num- 
ber of verbal acts correctly performed under a 
given set of conditions. Very great attention has 
been given to the quantification of these verbal 
exercises and the statistical treatment of data se- 
cured through them. ll statistical calculations 
involve, however, assumptions and these assump- 
tions need most systematic study as they relate 
to the measurement and prediction of teacher ef- 
ficiency. Whether these statistical-verbal oper- 
ations are profitable or not for measuring and 
predicting teacher efficiency needs further con- 
sideration and more study, notwithstanding the 
very great amount of time and effort already de- 
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voted to it. 

Finally, a problem that must be of continued 
concern to those interested inthe measurement 
and prediction of teacher effectiveness is that of 
an adequate criterion. By and large, and with 
many exceptions, two criteria have been used: 
1) efficiency ratings of one sort or another, and 
2) measured pupil gains. Both present real dif- 
ficulties. Over all, general ratings of teacher 
effectiveness have been shown to be, under cur- 
rent conditions, exceedingly unreliable. Depend- 
ing upon one’s point of view, this unreliability 
provides a substantial road block or a challenge 
to the researcher interested in this area of re- 
search. Afurther difficulty arises out of the fact 
that where a number of subjects are employed, 
as is usually the case, drawn from a number of 
different school systems, or even from the same 
school system, the teachers rated are generally 
not rated upon the same performance. That is 
they do different things. While the differences in 
what teachers do are not ordinarily as extreme 
as juggling acts and memorizing non-sense syl- 
lables, they are nonetheless different. Thus, to 
use efficiency ratings, even with well developed 
scales and highly trained raters, one must as- 
sume a large amount of transfer from one set of 
tasks to another (tasks which may be called teach- 
ing), to measure and predict teacher effective- 
ness. 

The use of measured pupil gain as a criter- 
ion of teacher effectiveness also presents very 
realdifficulties. First of all, each teacher in 
the modern School, within very broad limits, 
chooses his own purposes, means, and methods 
of instruction. These ord inarily vary from one 
School system to another and within named grade 
levels and subject fields. Regardless of the val- 
idating data reported in test manuals, the tests 
used in developing the pupil gain criterion will 
have varying degrees of operational validity, ex- 
cept as the teachers agree to pursue certain 
Stated objectives whichcan be defined with suffi- 
cient clarity to provide like meanings to all the 
participants. А second difficulty arises out of 
the fact that, notwithstanding over a half century 
of effort, many of the outcomes of learning and 
of teaching are poorly or inadequately measured. 
The gaps in the criterion arising from inadequate 
tests with which to measure pupil gain will be 
found to be considerable. Finally, tests measure 
effects but not causes. The sources of the effects 
observed are not readily ascertained, even under 
carefully controlled experimental conditions. 
Some of these effects will reside in the pupils, 
some in their general and special capabilities, 
some in their previoustraining, and some in mo- 
tivation. A few of the effects are doubtles sly 
traceable to the home environment: socio-eco- 
nomic status, respect for school education, and 
direct assistance rendered by various members 


of the family. A few of the effects will be trace- 
able to the school and community: In some, teach- 
ers' and pupils' morale is high and in some it 1s 
low. The physical facilities of different schools 
and communities varygreatly. And finally, there 
are the direct and indirect effects of the teaching 
of other teachers, both inthe same and related 
subjects. One of the very best measures of a 
teacher’s effectiveness will be found in what his 
students do in subsequent course work. Accord- 
ingly, the problem of establishing an adequate 
criterion of pupil gain will not be an easy one. " 

The purposes of this monograph are: | E 
present a critical overview of some seventy- °. 
doctoral studies, all made at the University O 
Wisconsin, that pertain in some respe ct to the 
measurement and predictionof teacher tae 
ness, and b) to offer such general observations ad 
new hypotheses as appear to be supported by tb 
data containedthereinas may be of value ina fur- 
ther study of teacher effectiveness. | М 

As опе views these seventy-five studies as 
whole, they seem to have certain broad ee 
teristics. First of all, the studies are amen 
without exception descriptive in character, кА 
exploratory. The statistical devices us ed wee 
principally those of means, standard. deviations; 
the coefficient of correlation, prediction eq 
tions, and factor analysis, allof the descriptiv“ 
typeof research. Experimental research and sat 
pling are generally not em ployed. Some MON 
contend that this is a great lack, and in a certa a 
respect it is. To others, it might appear pects 
appropriate to reserve these more refined or @ à 
vanced types of research for later research when 
promising leads have been found and the danger 
of confounding the problem through needless eI 
plexity has passed. The principal purpose of t = 
investigations reported here has been to get pe 
preliminary ideas about the nature of teacher °t- 
fectiveness and how it might be evaluated and COUR 
dicted. Whenever possible, important аш 
have been duplicated by a second, and sometime, 
a third parallel study to secure information abo” 
the consistency of the findings. In several 09 
stances, follow-up studies were made after me 
vals of five andten years. In some instances, 1 
case study method has been employed to supple- 
ment statistical techniques. Taken as a whole, 
these many studies constitute a valuable source 
of ideas about what to do and what not to do in 
teacher personnel research. | 

A very large number of data-gathering device? 
of many kinds were employed in these investiga- 
tions, some constructed for the particular inves- 
tigation and some drawn fromthe literature. Most 
of the more promising data-gathering devices Te- 
ported in the literature for over a periodof more 
than thirty years have been tested in a variety of 
Situations and under somewhat comparable condi- 
tions. The data-gathering devices consisted of 


various sorts of observationaltechniques, rating 
scales, questionnaires, in ventories, and tests 
administered to both teachers and pupils. While 
the instruments were largely of a verbal nature, 
there were devices of a mechanical sort that meas- 
ured various aspects of persons. Almost every 
conceivable aspect of teacher ability, general and 
special, and evidence of efficiency was explored, 
including interests, attitudes, behaviors, knowl- 
edges, skills, and personality traits. Informa- 
tion was sought from superintendents, principals, 
supervisors, other teachers, pupils and the 
teachers themselves. One of the purposes of the 
analysis is toobtainnew information and insights 
about the validity and predictive efficiency of the 
data-gathering devices employed in the study of 
teaching. 

Finally, some assumptions appear to have 
been made in these studies about the nature of 
teaching. While there is data relative to most 
aspects of teaching andthe many special abilities 
associated with them, in general, the several 
studies seem to relate to those aspects of teach- 
ing considered common to the activities and abil- 
ities of many teachers. While teachers perform 
many activities not directly related to pupils as 
a whole, these studies seem to be concentrated 
chiefly upon the direct classroom activities of 
teachers and those related directly to teacher- 
pupil relationships. 

As one looks through the several investiga- 
tions one finds various terms used to designate 
or describe the successful teacher. Frequently 
the word ‘efficiency’ is used. One will note, too, 
that the term is sometimes appliedto the teacher 
as in teacher efficiency and sometimes to the 
teacher's behavior as in teaching efficiency. 
While the term efficiency' is not without limita- 
tions, possibly there might be some gain if this 
term were applied totheteacher's behavior rather 
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than to the teacher as a person. Such a proced- 
ure would be in keeping with an earlier position 
taken and stated in connection with the discussion 
of psychological problems. Possibly if the term 
were so used one might add somewhat to the ob- 
jectivity of discussions ofteacher-teaching effec- 
tiveness. Eventheteacher herself might look 
upon behaviors somewhat more objectively than 
traits of character or personality. This, of 
course, is merely a hy pothesis and will need 
careful consideration and data if such can be found. 

Remembering that the primary purpose of 
this report is to present a critical overview of 
certain studies pertainingtothe measurement and 
prediction of teacher effectiveness, done at the 
University of Wisconsin, answers will be sought 
to such questions as: 


1. What is the nature of the problem under in- 
vestigation? 

2. What was the methodology of these studies? 

What are the criteria of teacher effectiveness? 

How adequate were the statistical techniques? 

Are therealternative techniques that give 

better results? 

5. Are there other theories of the nature and 
structure of human abilities that might give 
better results? 

6. Are there discrepancies between teacher po- 
tential and performance that should be given 
more attention? 

7. What are the personal and professional pre- 
requisites to teacher effectiveness ? 

8. Can good teachers be distinguished from poor 
teachers on the basis of the data supplied in 
these studies ? 

9. What assumptions are made by these studies? 

. What overall conclusion might опе draw from 

and about these studies ? 


mo 
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CHAPTER II 


THE CRITERIA EMPLOYED IN THESE INVESTIGA TIONS 
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In general, with some exceptions, the crite- 
ria of teacher effectiveness employed in the in- 
vestigations here summarized are globalinchar- 
acter and of two sorts, namely: 2) efficiency rat- 
ings and b) pupil gains as measured by tests 
administered to the pupils before and after in- 
Struction. 

Before examining however, the criteria em- 
ployed in these investigations, may we consider 
first certain theoretical aspects of criterion de- 
velopment. It should probably be first recalled 
that the nature of the criterion will vary with the 
prediction to be validated. One may, for example, 
wish to predict the ability of students to complete 
a particular four year undergraduate program for 
the education of elementary school teachers, or 
to complete the program for the education of sec- 
ondary school teachers of Science, or to predict 
Success in any or all of the positions for which 
teachers prepare within Some broad area of spe- 
cialization; or one may desire to predict on the 
job effectiveness of teachers in particular teach- 
ing assignments and Situations or to predict some 
highly generalized Sort of teacher effectiveness 
that may encompass a very great variety of posi- 
tions and situations. The interests and goals of 
Tesearchers are different and these are ordinarily 
respected when the investigators intent is ade- 
quately verbalized. 
point sometimes forgotten is that predic- 
made on some sort of time sequence, i. e. 
it starts some place and is presumed to end some 
Place. One might Start, for example, to make 
predictions in the senior year in high school, in 
the junior or senior division of college, or after 
à year or two of teaching as for probationary 
teachers. The immediate terminal concern of the 
investigator may be with any later pointin the se- 
quence: graduation from college, initial on-the-job 
effectiveness, Say, after one or two years of teach- 
ing, or with whatever later period with which the 
investigators concern may be. This time Se- 
quence has import for the nature of the criterion. 
Sometimes ones concern is merely with achieve- 
ment, academic or otherwise, ata particular 
point in the Sequence; sometimes ones concernis 
more with potential thanwith curr ent effective- 
ness; or it may be with both. As one passes from 
predictions about in-college-success to predic- 
tions about on-the-job-success the nature of the 
criterion employed may change, and the relative 
emphasis upon potential and acquired effectiveness 


may shift. Even with on-the-job eva riety 
the administrator is in varying degrees оиса eu 
in the teachers potential, as wellas current effec 
tiveness. 

Keeping in mind these two concerns, namely 
that which refers to potential and thatwhich refers 
to already achieved competency, as they relate z 
the criterion, one may wish to recall the sorts 

iteria commonly employed. Ж! 
ue are iren commonly employed сте 
encompassing four approaches to evaluation. The 
criteria most commonly employed are: 3 

1) Efficiency ratings, which may be made | 
any number of persons, but mostfrequently by ie 
Superintendent of schools or other members of hi 
Staff; | 

2) Measures of pupil growth and achievement 
usually adjusted for differences in intelligence ang 
other factors thought to influence growth and 2 
chievement; and А M 

3) A preservice graduationcriterion eph 
posed of a) measures ofthe foundations of = 
ficiency: basic knowledges, skills, and a tti tude » 
and b) the personal prerequisites to effectiveness; 
and professional competencies asinferred fro 
observation of performance in practice teaching, 
internships, and other activities involving children 
Embodied within these criteria are four approache ^ 
to teacher evaluation, combined in different way? 
by different persons, institutions, anddata gather- 
ing devices, namely, a) evaluations made in terms 
of the qualities of the person, as in personality bae 
ing; b) evaluations which proceed from studies о 
teacher behaviors, as in the rating of performance 
in terms of inferred personal qualities or apa Я 
ble professional characteristics; c) evaluations 5 
veloped from data collected relative to presum E 
prerequisites to teacher effectiveness, potential or 
already achieved, represented by such Deno 
ical constructs, as knowledges,skills and attitude : 
and d) evaluations developed from studies of th J 
product, as for example, pupil growth and achieve 
ment. i 

Each of these several approaches to the us 
opment of criteria has advantages and disa 4 
vantages, strengths and weaknesses, assets an 
liability. We would like to consider carefully now 
the problems associated with each, beginning first 
With the qualities of the person or traits approach- 
First of all, it should probably beobserved that 
qualities such as considerateness, cooperativeness; 
ethicality and the like are not directly observable 


but inferences drawn from data. These daia may 
be of many sorts arising from the observation of 
behavior, interviews, questionnaires, inventories 
or tests. Whatever the source of information, 
judgments about the qualities are inferences and 
subject to all the limitations, associated with in- 
ference making including the accuracy of the orig- 
inal data upon which the inferences are based, and 
the processes of inference making. Beyond this 
there is a most difficult problem in semantics a- 
rising out of the problem of attaching common 
meaning to the terms employed. Many persons 
have discussed this matter. Some have attempted 
to overcome this difficulty by resorting to behay- 
ioral or operational definitions. Let us look atthe 
matter more closely. 

First, let us recall that there are many the - 
ories of personality. As the word personality it- 
self suggests, most of these theories relate to 
characteristics of the person; thus we speak of 
personality traits. Another way of looking at the 
subject, however, is to consider not qualities of 
the person but characteristics of performance or 
behavior. Whichever approach is used, there is 
trouble ahead, since almost any approach has lim- 
itations and assets. Many persons would prefer a 
behavioristic approach, and what follows is dis- 
cussed in these terms. 

In pursuing a behavioral approach, we must 
recognize, however, that we immediately remove 
from consideration such aspects of personality as 
height, weight, age, complexion, bodily propor- 
tion, and physique, unless these static aspects of 
personality can be translated into behaviorial e- 
quivalents. Even though such static qualities may 
present difficulties to those who would interpret 
personality in behavioral terms, a behavioristic 
approach still has some advantages inthatsuchan 
approach makes it possible to integrate the con- 
cept of personality with that of methods, whichhas 
always been considered an important aspect of 
teacher effectiveness. Inasense, method, broad- 
ly conceived, encompasses all teacher behavior 

lity. 

и So с ШЕ problem inthis way our 
concern stated in question form becomes: Cande- 
scriptions of behavior provided by such terms as 
considerateness, со-О erativeness, expressive- cd 
позз, Gblectivity S teacher effectiveness? Pos- 
Ways of considering te 

Sibly, perhaps, this particular ui ese ch e r 
prove to be too remote to have any great prac ical 
value and other descriptive p be better; 
this also needs careful consideration. 

Psychology has defined the conditions d p^ 
fective learning in terms of certain репе m 
learning. This suggests the question: Are the 
techniques of teaching that are presumed to grow 
out of learning theory encompassed by the person- 
al qualities associated with personality traits, or 
аге the behaviors found in the techniques of 
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teaching something different? Possibly they con- 
stitute another constellation of values that one needs 
to keep in mind. Possibly there is some unique 
constellation of human behaviors that constitute the 
essence of personality, and another constellation 
of activities that constitute technical competency. 
These are important considerations incriterion 
development. 

If we attempt to characterize behavior in such 
broad terms as those suggested by personality 
traits, we must give some attentionto choosing and 
defining the personal qualities that appear to be 
pertinent to teacher effectiveness. Many words in 
a standard collegiate dictionary purport to describe 
personal characteristics. How does one choose 
from these? The literature gives one the impres- 
sion that the choice of vocabulary has been based 
pretty much on perfonsl preference. 

Some years ago, the writer served on a pro- 
fessional jury that attempted to prepare a short list 
of descriptive terms to be used in teacher evalua- 
tion. More recently the author compiled a list of 
terms used to describe teaching effectiveness in 
studies on the measurement and the prediction of 
teacher efficiency. Insome manner we need to 
develop a list of the aspects of the personor of the 
behavior that need to be considered. Once alist is 
agreed on, each term in the list must be defined. 

Before turning to problems of definition, there 
are several questions one might ask about the list 
itself. How long should it be? How much overlap 
can one expect or tolerate? Are the different qual- 
ities to be looked upon as supplementary or com- 
plementary, or may they be conflicting? Are there 
hierarchies, patterns, or sequences of behaviors, 
or of qualities that we should consider? If the qual- 
ities are behavioral defined can some aspects of 
behavior be thought of as superficial, unimportant, 
or trivial and others as basic, highly potent, and 
primary? Should the terms used to describe teach- 
er behavior reflect some particular philosophy of 
education, theory of learning, or concept of human 
relationship? 

To provide acceptable working definitions of 
the descriptive terms to be used insuch an ap- 
proach is extremely difficult. Presumably, if one 
makes a behavioristic approach all definitions will 
be operational definitions. From this point of view 
what does a reliable, emotionally stable, and re- 
sourceful teacher do? If judgments about teachers 
are to be based on observations of teachers’ beha- 
viors, how do we know what to look for and what to 
ignore? Over and above the counting of behaviors, 
if that is our concern, there is also the matter of 
pertinency. Whether a behavior, or aspect of be- 
havior, is pertinent to some particular quality de- 
pends on how the quality is defined. If the list of 
terms is highly condensed, many subtle shades of 
meanings will probably need to be considered. 

Having listed and defined the terms tobe used, 
one may then turn to the collection of the data, 
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There are many different sorts of data gathering 
devices. Bywhat means may observers reach 
sound judgments about whether the data collected, 
or to be collected, may be consideredas evidence 
of the presence or the absence of some particular 
quality? Ifone is observing behaviors, can behav- 
iors be consicered out of context? What aspects 
of the context should one consider? Is the noting 
of the presence and absence of behaviors suf- 
ficient? What dimensions of behavior should one 
consider? Is counting enough, or should the be- 
haviors be evaluated according to some scale of 
values? Should one consider isolated behaviors 
or patterns of behaviors? Should the impact of 
particular behaviors as contrasted with mere 
presence or absence of behaviors be considered? 
Their Extent? Duration? or Intensity? How will 
the score, if there is a score, be expressed? 
How may one summarize the data? 

When one attempts to reach some overall 
judgment about teacher effectiveness from judg- 
ments about the separate aspects of personality, 
One is confronted with a further necessity. It is 
common practice to give each item a numerical 
value. These items are then added and divided 
by their number to calculate some sort of aver- 
age. But can we safely assume that these values 
can be added? Is an average an adequate repre- 
Sentation of the data from which inferences may 
be drawn? Do some aspects of behavior have 
Spe cial potencies in and of themselves? Are 
there upper and lower cutoff points inthe amounts 
of these values that an effectiveteacher must 
possess? May a teacher's overall efficiency rest 
on the presence or absence of some particular 
quality of behavior instead of an average of many 
values? Do various combinations of behaviors or 
qualities have particular significance? 

In spite of all of the problems that come out 
lities of the person as a 
ness there are many reasons 
consideration. First, most 


behaviors, in 
ical elements 
ternatives from 
cular situation. 
inarily many al- 
havior, one being 
: Thequality ap- 
ns of getting bı in- 
Cidental to the critical. ru ы ре 
consider personal fitness an important considera- 
tion in and of itself, completely aside from its ef- 
fects, at least aside from its primary or direct 
effects. In this sense personal fitness is an im- 
portant criterion. 

The criterion of teacher effectiveness may 
alsobe behaviorally defined, directly, and without 


the summarizing operations provided by person- 
ality traits. Behaviors have already been in- 
volved in the discussion of quality oriented cri- 
teria, but there they were employed largely as 
building stones out of which judgments about the 
personal prerequisites to teacher effectiveness 
were constructedandas a means of summarizing 
and defining the personal prerequisites of teach- 
er effectiveness and not as criteria inand of 
themselves. But behaviors may themselves be- 
come criteria. A very attractive feature of a be- 
havioral criterion is that behaviors may a 
directly observed by all who care to look. | Wit 
more adequate instrumentation observability Сал 
be expected of internal behaviors as well as ех- 
ternal behaviors. It seems quite reasonable to 
expect, with the development of appropriate tech- 
niques, to attain a very high degree of objectivity. 
This, of course, is a highly desirable feature of 
a criterion of teacher effectiveness. But here too, 
as withothercriteria, one runs into difficulties. 
The problems that one encounters in this approach 
are, however, of a different order. To many per 
sons behaviors are merely the surface aspect 0 
life and they would look beyond these to what they 
would call the essence of things. They would look, 
for example, for the primary mental prerequ! 
Sites to teacher effectiveness or toqualities of ше 
person. There are also those that would arg" 
that a behavioral criterion is too cumbersome 
There are just too many behaviors to make аса 
approach practical. One purpose of science 15 an 
achieve a degree of simplicity and control in " 
exceedingly complex world. From this pome а 
view there are just too many behaviors to de а 
with them individually. Thus some psychologis с 
attempt to categorize, generalize and structure 
behaviors in some fashion to secure control ové 
them. ‚© 
Another difficulty into which those who have 
attempted to build behaviorally oriented criter!^ 
have run is that of alternatives. With highly sim” 
plified situations as in a particular highly simpli”, 
fied learning maze there may be few alternatives, 
but in most classroom situations there are many 
alternatives; the restrictions generally speaking 
are only those found in the minds of man. POS 
sibly more could and should be done with catego” 
rizing and generalizing these alternatives; th 
quality approach already discussed is one means 
of doing this; there are doubtless other ways ° 
doing this. à 
Another problem that has arisen to plagu 
those who would construct behavior criteria i9 
the problem of context or appropriateness. EX” 
cept in highly simplified functions and models; 
acts (i. e. specific behaviors) cannot be said to be 
good or bad in and of themselves. They are good 
Or bad; effective or ineffective;appropriate or in^ 
appropriate when considered in relation tO 
purposes, persons and situations. To consider 


their worthwhileness out of context is much like at- 
tempting to consider the question: Which is bet- 
ter, a hand saw or a screw driver? Well, the an- 
swer is: it depends upon the purpose, the person 
involved, and the immediate situation. We shall 
examine this problem further when we examine 
the criteria employed in the investigations here 
under consideration. 

Another approach tocriterion development is 
that which employed such psychological concepts 
as the knowledges, skills, and attitudes in terms 
of which the purposes of education have been so 
generally expressed. Inthis approach the empha- 
sis would appear to be upon the mental prereq- 
uisites to teacher effectiveness as contrasted with 
the bio-physical prerequisites. If one assumes 
that the teacher bring his whole self to teaching, 
this is not the whole self but the mentalself. Even 
so, the concept is an important one. These men- 
tal prerequisites are presumed to act as controls 
over behavior and thus control teacher effective- 
ness. If we think of qualities as a convenient way 
ofsummarizing andcharacterizing behavior, 
knowledges, skills, and attitudes are the moni- 
tors of behavior; and as suchthey become anim- 
portant part of the machinery for assessing effec- 
tiveness except possibly for the subjects and ac- 
tivities heavily loaded with psychomotor content. 

The criterion here discussed is the one or- 
dinarily applied upon the completion of the certi- 
fication program or later when certification may 
be by examination. It aims chiefly at potential in 
that it may be applied prior to employment. 
Properly applied it has substantial value when ap- 
plied singly or in conjunction with other criteria. 

The problems associated with this criterion 
are those associated with testing everywhere. 
The basic one is that of validity but associated 
with it are all the problems that one may encounter 
in test construction in any field. Presumably one 
starts with a set of well defined and carefully val- 
idated objectives. The objectives are the objec- 
tives of the teacher education program. Some 
sort of a curriculum is assumed; and it is assumed 
that this curriculum has some established rela- 
tionship to the purposes of teacher dean 
as one might develop through the pr орен села ер 
riculum making. The testing is most zeguen y 
made in terms of the knowledges, ski , an lat 
titudes sought in the — E NM p и : | 2 
ulum. A very real value а 1800 
this erent te to keep those engaged pes 
development reminded of the E od i» à 
pected by the concept of teaching. Inthis re нч 
as important as the directionof iacente in 
classroom situation is, it is only one of the many 
functions performed by teachers. Teachers are 
also supposed to be friends and counselors of pu- 
Pils; teachers today are asked to participate in 
many extra-curricular activities; and teachers 
engage in many activities associated with their 
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profession. If pupil growth and achievement is 
looked upon as the ultimate criterion of teacher 
effectiveness, the mental attributes here pre- 
sumed to be prerequisites to teacher efficiency 
constitute an immediate or proximate criterionof 
effectiveness. 

A fourth type of criterion of teacher effective - 
ness is that of pupil growth and achievemen t, 
which is usually expressed as pupil gain scores 
based upon achievement tests administered prior 
to instruction and again at some Subsequent date 
when a particular unit of instructionor course has 
been completed. To most persons this criterion 
is considered a primary criterion against which 
all other criteria should be validated. Like th e 
other criteria it is subject, however, to very def- 
inite limitations. 

First of all the criterion of pupil growth and 
achievement is built about the classroom activi- 
ties of the teacher. Directing the learning of pu- 


.pils, as has already been said, may bea primary 


responsibility of the teacher but not her sole re- 

Sponsibility. Besides directing the learning of 

pupils, teachers in most school systems are sup- 
posed to be friends and counselors of pupils, they 
are expected to be faculty advisors to or directors 
of many extra-curricular activities, they partici- 
pate in educational policy making and advise the 
administration as individuals and as groups through 
committee action, they must cooperate and work 
with their co-workers in the discharge of ma ny 
responsibilities, they are called upon to partici- 

pate in many community activities and they are 

members of various professional groups. Com- 

petency in these extra-classroom activities weigh 
heavily in the worth that most administrators at- 
tach to the teacher. 

Another difficulty arises in fitting the gains 
tested to the instructional goals of the teacher. In 
global survey testing the problem is that of chos- 
ing tests that faithfully represent the generally 
accepted purposes of educationand those of teach- 
ers in specific learning-teaching sitvations. The 
tests, and other measuring instruments, may be 
valid and reliable in some highly generalized sit- 
uation but may not be in keeping with the demands 
of the particular situation or in keeping with the 
teachers purpose. Workers in this area have at- 
tempted to overcome this difficulty ina number of 
ways: a) Some have sought to secure mor e u- 
niformity by selecting pupils with common needs 
and teachers with common purposes; b) Some have 
given up global testing and have substituted for it 
custom-made testing where each testing program 
is individualized and tailored to the needs of par- 
ticular learning-teaching situations; and c) Yet 
others have attempted to randomize the ef- 
fects and variables by different sorts of statistical 
devices. The difficulty is not easily resolved. 

Yet another difficulty arises out of Securing 
valid and reliable measures of the accepted 


14 JOURNAL OF EXPERIMENTAL EDUCATION 


purposes of education. While much progress has 
been made in developing valid and reliable tests, 
few would hold that adequate tests have been de- 
veloped for the major purposes of school educa- 
tion. Substantial progress has been made in the 
realm of direct recall, recognition and informa- 
tion tests but less progress has been made іп 
measuring the products of the teachers efforts in 
such areas as problem s olving, personality de- 
velopment, mental health, aesthetic learning and 
emotional growth. Generally speaking the tests 
ordinarily used in developing a pupil gain crite- 
rion are quite limited in this respect. 

It should, also, probably be recalled that tests 
measure results but provided little information 
about how these effects were produced. The 
teacher effect is only one of many effects that 
produce changes inpupil growth and achievement. 
One of the real difficulties that arises in the uti- 
lization of this criterion is that of isolating the 
teacher effect. There are many other effects: a) 
a really good prior teacher or current colleague 
may produce measurable changes inall subsequent 
course work and in the achievement of pupils 
taught by other teachers. The same can be said 
of teachers who effectively teach fortransfer. 
Their influence will be felt in all classes where- 
ever their pupils go; b) There is also much di- 
rect instruction in every class not directly trace- 
able to the teacher. This instruction is provided 
by other pupils, pare nts, and contemporaries 
generally; and c) Self-teaching and lear ning in 
Spite of the teacher is always possible. Some of 
this may be done by self-teaching texts and ma- 
Chines, 

Besides the very broad problems and diffi- 
Culties here discussed, there are many technical 
problems that have already been adequately re- 
ported in the literature. 

In the brief statements here given, some of 
the more commonl 
terion developmen 


plementary rat 


Strengths can possibly be preserved and the weak- 


ong 
ion. 
ials 
lstudies here sum- 


marized to further clarify the problem of criteri- 


on development. 

The series of studies here Summarizedas has 
already been said, employed a variety of criteria; 
some of the studies were directly concerned and 
some not with criterion development. All con- 
tribute ina manner tocriteriondevelopment, none 


the less, in that they aimed toprovide general 
orientation for the measurement and prediction 
of teacher effectiveness. One of the early studies 
not directly concerned withcriterion development 
but pertinent none the less was that of Barr and 
Emans (7) in which they attempted to secure in- 
formation about the characteristics considered by 
supervisors and administrators in the rating of 
teachers. Two hundred and nine rating scales 
were analyzed. From their analysis it would ap- 
pear that the typical rating scale covered such is 
tems as 1) Classroom management (attention to 
physical condition, housekeeping and appearance 
of room, discipline, economy of time, records 
and reports, and attention to routine), 2) I 
structional skill (selection and organization o : 
Subject matter, definiteness of aims, skill in as 
Signment, attention to individual needs 5 skill in 
motivating work, attentionto routine, skill in ai 
recting study, skill in stimulating thought, daty 
preparation, pupil interest and attention, рар. 
participation, attitude of pupils, results), 3) Рет 
sonal Fitness (some twenty-nine items? y 
4) Scholarship and Professional Preparation; : 
Effort toward improvement; 6) Interest in wor : 
and (7) Ability to work with others. From this an 
alysis it would appear that the chiefconcern ks 
the administrators in the late twenties was wit 
the teacher in the classroom. — 

From a comprehensive survey of the liter 
ture, Barr (4) attempted to provide a generaliza 
definition of the teaching process, in whic h 
conceived of the major operations as being: í 
Determining pupil need (searching for causes 0 
satisfactory and unsatisfactory pupil growth a 
achievement); 2) Formulating educational obje a 
tives; 3) Choosing means, methods, and matet 
als; 4) Guiding the learning process (assurW* 
favorable condition, and overseeing the ргосе55/' 
5) Evaluating outcomes. ge 

Another attempt was made by Barr (5) to v 
certain the concerns of those who have conduc ^ 
research relative to the measurementand pee. 
tion of teacher effectiveness. The main categ? 
ies of concerns were found to be as follows: 


I. Personal qualities (Fourteen items) 
Il. Competencies 


A. As director of learning 

1. Skill in identifying pupil needs 

2. Skill in setting and defining of 
goals А 

3. Skill in creating favorable mind 
sets (Motivation) 

4. Skill in choosing learning ехрег” 
ience 

5. Skill in following the learning 
process 

6. Skill in using learning aids 


Skill in teacher pupil relations 
Skill in appraising pupil growth 
and achievement 
9. Skill in management 
10. Skill in instruction (General) 


ox 


IH. Effects of teacher leadership (Results) 
. IV. Behavior control 


A. Knowledges 

1. Knowledge of subject matter 

2. Knowledge of child behavior and 
development 

3. Knowledge of professional prac- 
tices and techniques 

4. General cultural back groups 

5. Scholarship 


Generalized Skills 

1. Skill in problem solving 

2. Work habits 

3. Skill in Human Relationship 
4. Skill in the use of language 


C. Interests, attitude, ideals 

1. Interest in pupils 

2. Interest in subject 

3. Interest in teaching and school 

work 

Interest in community 
Social attitudes 
Professional attitudes 
Efforts toward self-improvement 
Interests (General) 
Interests in extra-curricular ac- 
tivities studies such as this indi- 
cate the broad areas of concern 


оо чост 


Another source of information relative to the 
constituents ofa valid criteria of teacher effec- 
tiveness will be found inthe many studies that have 
been made of the curriculum for the education of 
teachers. Butler (15), Doane (18), Goldgruber 
(28), Mitchell (56), Schwahn (71) and Von Eschen 
(81) all conducted studies of the education of 
teachers. These studies contain detailed informa- 
tion about what teachers are Supposed to know, 
feel, and do as teachers. The instrument em- 
ployed by Schwahn, for example, in the collection 
of the data for his investigation, was constructed 
(after a careful examination of the literature) by 
a team of professionally competent scho ol men 
working as a statewide cooperative comm ittee. 
The instrument was responded to by some one 
hundred fifty-one members of the state college and 
the University of Wisconsin faculties engaged in 
teacher education. Considering the diversity of 
training and experience of the respo ndents, 
Schwahn’s summary constitutes an important 
Source of information about the elements that 
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should be encompassed in a valid criterion of 
teacher effectiveness as stated by the leadership 
for the state of Wisconsin. Three ways of de- 
scribing teaching efficiency were identified; 
namely 1) character and personality traits; 2) 
desired competencies, ability todo, performance; 
and 3) controls over behavior: knowledges, skills 
and attitudes. The relative values attached to the 
several aspects and activities of Teacher Educa- 
tion, expressed as ranks, were summarized un- 
der the following broad categories: 


, 


Pupil Health and Development 
General Education 

Educational Psychology 
Professional Relations 

Classroom Management 

Guidance 

Philosophy of Education 
Curriculum 

Educational Methods 

10. Community Relations 

11. Tests, measurements and evaluation 
12. School organization, practices, and 
support 


о со--о› сл нь омон 


If one accepts the findings of studies such as 
those here cited as indicative of the components 
of a valid criteria of teacher effectiveness most 
of the criteria employed in the series cf studies 
here summarized relate only to certain aspects of 
teacher competency, and not to overalleffective- 
ness. 

With the immediately preceding materials, 
defining the scope of teaching andthe earlier dis- 
cussionof theoretical considerations in mind, may 
we now examine rather systematically the cri- 
teria employed inthe series of investigations here 
summarized. The criteria will not be examined 
for all of the studies but only those that seem to 
have some unique features. One of the studies 
that employs some unique approaches to criterion 
development was one by Barr, Torgerson, and 
others (8). Five criteria were employed: 1 ) 
Gain in pupil achievement as measured by the 
Stanford Achievement Test, the gains being com- 
puted as a) gain in the total raw score, b) gain in 
the arithmetic score, and c) gain in the accom- 
plishment quotient; 2) a composite of scores on 
Seven rating scales; 3) acomposite of nine meas- 
ures of qualities commonly associated with teach- 
ing success; 4) a composite of six tests of teach- 
ing ability chosen from composite three; and 5) 
a composite of all nineteen variables combined 
variously. The major conclusions were: 1) The 
coefficients of correlation obtained between ten 
selected measures of teaching ability and gain pu- 
pil achievement are uniformly low; 2) the coeffi- 
cients of correlation between the nineteen varia- 
bles employed in the investigation and the five 
composite criteria provide conflicting evidence. 
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The authors cite the rating scales and tests that 
seem to be most valid according to the criterion 
employed; 3) a composite of the total pupil gain 
score on the Stanford Achievement Test, The 
Torgerson Diagnostic Teacher Rating Scale, and 
the Knight Aptitude Test yielded a Multiple Cor- 
relation of .70 with a composite of all measures 
employed as criteria; 4) fourteen of the measures 
had a forecasting efficiency superior to general 
merit ratings; and 5) when the Torgerson Diag- 
nostic Teacher Rating Scale and the Knight Apti- 
tude Test were employed to predict ratings in five 
categories represented by A, B, C, D, and E 
letter ratings, 6475 of the predictions fell within 
the correct criterion group, 3275 were misplaced 
by one group and only 4 per cent were misplaced 
by two letter groups. 

The criteria were carefully chosen. They 
were based upon a careful study of the literature 
in the field and prolonged theorizing about the na- 
ture of teaching ability by the team that conducted 
this investigation. The Superintendents respon- 
Sibility with reference to the teaching personnel 
was recognized by one set of measures. From 
the point of view of school organization and ad- 
ministration this must always be, whether valid 
or not, a primary criterion. The teacher rating 
Scales were carefully drawn and were the best to 
be found. There were six of these. The cri- 
terion of tests of qualities thought to be associated 
with teacher effectiveness were those that seemed 
to be best in terms of the measures that were then 
available and Supported by data in the literature. 
There were nine of these, relating to character- 
istics hypothesized to be important in teacher ef- 
fectiveness. The pupil gain scores were based 
upon the Stanford Achievement Test. While, as 
pointed out by the authors, the criteria employed 
are not without inadequacies, arising in part out 
of the invalidities and unreliabilities of the sever- 
al measures employed, taken individually, but 
arising also in part from other inadequacies, the 
Study does point up Certain matters that one should 
keep in mind. One of the findings is that different 
Criteria measure diff 


є erent aspects of teacher ef- 
fectiveness. Based upon data such as these and 


considering our present state of our knowledge 

many persons believe that if one desiresan over- 
all criterion of teacher effectiveness, probably 
the safest procedure is toemploy a variety of 
measures, all possessing validity from Some par- 
ticular point of view, applied and evaluated by 
more than one person, and based upon studies of 
the teacher over a considerable period of time. 
If one does not desire ап overall competency eval- 
uation, the several co 


mponents may still be con- 
sidered separately. If one examines the correla- 
tions from this point of view it can be observed 


that none of the correlations with the pupil gain 
criterion are high with about as many negative cor- 
relations as positive ranging from -.32 for the 


Giles Teacher Rating Scale to . 23 for the Wood 
Health Scale. The only correlation of any size 
(.63) is between aGeneral Merit Rating piro d 
posite score on six Teacher Rating Scales which 
is probably due to a halo effect. When a compos- 
ite of nine measures of qualities thought to pons 
ure teaching ability was used as the criterion al 
of the correlations were around zero , 08 for pu- 
pil gain, and -. 06 to .12 for the six teacher € 
ing scales. When the criterion is a composite е 
all nineteen measures taken either singly or a 
three equally weighted components the i 
correlations, ranging from .74 to . 84 were ы 
the teacher rating scales arising chiefly outo Š 
halo effect arising from the fact that the er 
persons made the teacher ratings. Very Wis 
the different criteria give different results. ° 
can make differential predictions but the e fa 
tiveness of a prediction depends upon the cri 
rion. е 
» Another illustration of the multiple rem] 
proach to criterion development will be foun : 
a study by Lins(49). He employed three в 
criteria: 1) supervisory ratings; 2) pupil eva «d 
tion; and 3) residual pupil gain. The super: 
rating criterion was a composite of five — 
two by members of the Department of Education 
University of Wisconsin, one by a representa" 
of the State Department of Public Instruction, 
by the principal or superintendent under whom da 
teacher taught, and one by a member of the : 
partment of educational methods under whom a j 
teacher had done her practice teaching. TE 
ings were all made on the Wisconsinadaptati on 
the M-Blank of the Evaluative Criteria plus x 
tain other instruments described in the oe i 
report. The lowest correlations of any one gr 08 
of individuals with the composite was .72 = The 
and with other individuals was . 403 +. 121. the 
reliability of the criterion determined by hel 
chance halves method and the Spearman-Br ere 
prophecy formula was .862. The ratings pon 
preceded by almost one full year of weekly ой 
cussions among the members of the team respo- 
Sible for the collection of the data and each eri 
er was visited by a trained observer at eee 
for more than a single class period, usually a т. k 
Schoolday, in which she was observed at W all 
and interviewed. The pupil evaluations were ri 
made according to a carefully designed plan in 
under the direction of a single person who VIR S 
each school and secured the evaluation by ano he 
mous ballots. The residual pupil gains were a 
discrepancies between the actual gains made a E 
certain standardized subject matter tes ts, ain 
Scribed in the report, and a predicted pupil pra 
based upon a four-variable prediction equation 
rived from average gain scores, the pr ete sj 
Score, mentalage, and an intelligence quotien ” 
These criteria were established with great car 
One of the most important findings was the 10 


intercorrelations among the three criteria. These 
‘correlations were as follows: 


x X, 


1 2 


Ху Composite M-Blank 
ratings 1.000 .279 .193 


Xo. Pupil evaluation . 279 1.000 . 055 


X4 Residual pupil gain .193 .055 1.000 


In this investigation the three criteria were 
not combined into a single global criterion but 
each was treated separately. Some teachers were 
preferred by the administration, some were liked 
by the pupils and some taught in classes where 
there were substantial pupil gains in terms of the 
tests employed to measure pupil gains, and gen- 
erally speaking these were notthe same teachers. 

These findings are in substantial agreement 
with those of Barr and others (8) previous ly 
cited. Many of the correlations are quite low н 
but enough statistically significant correlations 
were found to give multiple R of 14 with the re- 
sidual pupil gain: . 72 with a composite of super- 
visory ratings and .60 with pupil evaluation of the 
teacher. Obviously many things contribute to the 
low zero order coefficients of correlation. These 
low coefficients of correlation arise in part be- 
cause of the discrepancies that arise between 
theory and practice, i.e., between the ideal and 
the actual, that have been frequently noted in the 
literature. Some would correct this situation by 
narrowing the area of investigation and by intro- 
ducing better controls. This is a very worthwhile 
concern but not the problem to which this particu- 
lar investigator addresses himself. His concern 
was that of predicting teacher effectiveness when 
viewed by a variety of persons, under varyi ng 
conditions, and where more than one Sort of cri- 
teria are employed. For those who wish to make 
prediction under carefully controlled c o nditions, 
the very great number of experimental studies of 
learning and teaching methods reported in the lit- 
erature provide a gold mine of tested materials of 
this sort, especially if it is teaching and iue 
efficiency that is the investigators CONGR à р 
is especially true if a behaviora app — 
made to teacher effectiveness and ^ s о; 
broadly conceived to encompass total be son 

A somewhat different approach to 2 p 
development was made by Rostker (66). E = 
first plate he limited his study to the poate ing of 
citizenship in the eighth grade of non-departmen 
talized one-teacher schools. Pre- and post-tests 
purporting to measure the outcomes of such a 
course were administered near the beginning of 
the school year and six months later plus pre and 
post unit tests. The tests were all given by trained 
examiners. The Wrightstone tests of “Applying 
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Generalizations to Social Studies Events." “ Abil- 
ities to Organize Research Materials, ' and “А 
Scale of Civic Beliefs" and the Hill Test in Civic 
Attitudes, and the Hill Test in Civic Information 
were administered to all pupils. An attempt was 
made to measure some of the 1:55 tangible out- 
comes of citizenship instruction. Besides these 
overall measures each teacher was asked to two 
different units of subject, the same for all teach- 
ers with pre and post instruction tests. 

In order to calculate the residual pupil gains 
the Kuhlmann-Anderson Intelligence Test, The 
Traxler Silent Reading Text, and the Sims Score 
Card for Socio-Economic Status were adminis- 
tered. Prediction equations were developed for 
the eight separate measures of pupil gain and for 
a composite of the several measures that pur- 
ported to measure factors conditioning achieve- 
ment. The statistical treatment of the data was 
reasonably sophisticated. The several criteria 
are treated in such a manner as to make it pos- 
Sible to observe the particular strengths and 
weaknesses of each teacher, were one interested 
in the problem of differential prediction of abili- 
ties or the education of teachers inservice. Some 
researchers in this area believe that differential 
prediction is an important matter since teachers 
cannot be equally competent in all respects as is 
Shown by the data. At least part of the problem 
would seem to be that of ascertaining the respects 
in which teachers are strong and weak. 

Rostker (66) gave much attention to the de- 
velopment of an adequate criterionofteacher ef- 
fectiveness. In the first place he attempted 
through the use of the Hill and Wrightstone Tests 
to measure something more than informational 
learning. Then, he attempted to measure Some 
Short time achievement and some longer time 
outcomes. He, also, attempted to isolate some 
of the pupil influences on learning througha mod- 
ified analysis of co-variance. Among his findings 
which seem important for criterion building are 
these: 


1. The intercorrelation between the raw gain 
scores on the unit achievement tests for two very 
carefully standardized units whichall teachers 
taught was .14; the correlation between the com- 
posite unit raw gain score and the Wrightstone 
raw gain score composite was . 02 andthe corre- 
lation between the unit raw gain score composite 
and the Hill raw gain score composite was . 12 as 
was the correlation between the Wrightstone and 
Hill raw gain scores. For the adjusted composite 
gain scores the correlation between the unit scores 
and the Wrightstone scores was .38; between the 
unit Scores and the Hill scores .61;and between 
the Hill scores and the Wrightstone scores „85, 
which all seems to indicate, along with errors of 
measurement, these composites measure differ- 
ent things. 
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2. Rostker does not give the coefficients of 
correlation for the several different criteria but 
for the Single one over all criterion. For this 
criterion, only seven of the thirty dependent var- 
iable scores gave coefficients of correlations of 
.30 or more as follows: 


1. The Torgerson Diagnostic Teacher 
Rating Scale .43 
2. The Michigan Teacher Rating Scale .39 
3. The Hartman, Social Attitudes Test .38 
4. Almy-Sorensen Teacher Rating Scale .36 
5. Personal Fitness (Based upon the 
Charters list) 85 
6. Size of School (Number of Pupils) .31 
7. A Wisconsin Personality Test .30 


It is interesting to note that, except for the 
Torgerson Diagnostic Teacher Rating Scale, the 
Size of the school was about as effective as any- 
thing else in predicting teacher effectiveness as 
here measured. 

Anderson (1) chose as the major purpose of 
his research a study of the criterion itself. His 
analysis is based upon data gathered through the 
use of the following data-gathering devices: 

l. The principals rating of the teacher upon 


d Wisconsin Adaptation of the M-Blank 


2. A rating of the teacher by pupils on an 
adaptation of the Bryan Reaction to 
Instruction Questionnaire 

3. = Self rating upon a special form 

e 

4. A rating of the teacher by his peers upon 
à Special form (Pe) 

2 A state supervisory rating (Ax) 


Pupil score on an initial administration of 
Standardized achievement tests (P.T.) 
7. Final scores on Selected standardized test 


(F) 
8. Residual pupil gain (AG) 


The intercorrelations among these criteria are 
Shown at the top of the next page. 


Among Anderson’s conclusions one finds state- 
ments like the following: 


1. No correlations appreciably different from 
zero were found between the evaluations of 
teachers made through the several ratings 
and pupil achievement as measured inthis 
investigation. 

2. 


The achievement tests employed insuch in- 
vestigations must have curricular validity 


and the pupil gains must be large enough to 
be statistically significant. 


3. Most ratings are very subjective and the 
intercorrelations among them low. 


А nder son's findings seem tobe in substan- 
tial agreement with those of Lins (49) and Barr, 
Torgerson and others (6). | | 

A number of the studies employed ratings in 
one form or another as the sole criterion of 
teacher effectiveness. Hampton (33) for example, 
used the Estimate of Teacher’s Qualifications 
Based on Teaching Experience, used at Iowa 
State Teachers College as an instrument to assess 
the success of Iowa State Teachers College ба 
uates. For her study she chose from this blan 
twelve items as follows: 1) cooperation and loy- 
alty, 2) knowledge of subject matter, 3) cour- 
tesy and friendliness, 4) interest in school E 
tivities, 5) discipline, 6) emotional poise, 3 
general culture, 8) health and vitality, 9) рас 
appearance, 10) resourcefulness, (11) response 
to criticism, and 12) speech. These character 
istics are among those frequently found in blanks 
of this sort. T 

From intercorrelations and a factor analys 
she concluded among other things that: 


1. A general factor did not appear to account ío” 
the intercorrelations. Whenthe same instr 
ment was used more than once on the sa? 
teachers, three factors seemed to accoun! " 
the intercorrelations but none of the facto?” 
appeared to be consistent in all three го 
tions. 


2. The correlations between successive trait 
ratings of the same persons were significan 
ly different from zero when the raters W е 
the same but zero when the raters change™ 


3. The trait ratings on a five-point scale and or 
a paired-comparison rating were all Po’, 
tively correlated with nine out of the t w e lv 
correlations statistically significant. 


4. The high correlations between the individu 
traits ratings and the general category r ae 
Seems to indicate that the individual trait ra 
ing added little to our knowledge. 

5. 


The high correlations between the individual 
ratings on Resourcefulness and Knowledge © 
of Subject matter with general merit rating? 
on the several instruments, would seem to i? 
dicate that these are more characteristics © 
good teachers, in the minds of superintend” 
ents, with Health and Courtesy negatively cor 
related with teacher efficiency. 


A number of the studies of this series em" 
ployed the Wisconsin Adaptation, of the M Bla 


l.m 2.pn 3.Se 
1.m ---- ----  ---- 
2.pn Q18 ---- ---- 
3. Se ;48 .80 ==== 
4. Ре .29 .38 .23 
5.АХ 257 .22 .33 
6.pt  -.04 .02 -.17 
ТЕ .02 .13  -.10 
8. AG 510 .11 8 


of the Evaluative Criteria, with a single school 
rating by the principal or superintendent, or mul- 
tiple ratings involving other professionalperson- 
nel, as the criterion. The blank represents the 
combined efforts of many persons. There is no 
attempt in this blank to be objective. The blank 
merely attempts to remind the rater of some of 
the more important aspects of teaching, and 
teacher characteristics, that he should keep in 
mind in making his evaluation, with space for 
supporting evidence. The major areas ofconcern 
are expressed as questions as follows: 


I. Teacher as a Director of Learning 


1. Isthe teacher well prepared? 

2. Has the teacher the personal prerequi- 
sites to do effective work? 

3. Are the goals and objectives set by the 
teacher to pupils adequate? 

4. Are the observed teacher and pupil ac- 
tivities well chosen? 

5. Does the teacher show skillin directing 
activities? | 

6. Are the aids to learning as observed ad- 
equately and effectively used? 

7. Аге the methods of checking results 

i ? 

8. fre eid ence of desirable pupil 

growth and development ? 


nd and Counselor of 


Il. The Teacher as a Frie 
Pupils 
1. Is the teacher interested in the pupils as 
ersons ? | | 
2. Dues the teacher givetime to the pupils 
as individuals? | 
3. Does the teacher contribute to whole- 
some pupil growth and adjustment? 
Ш. The Teacher as а Member of a Group of 


Professional Workers 


1. Does the teacher willingly and effective- 
ly participate in the activities essential 
to a good all-around school program ? 
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2. Does the teacher willingly and effective- 
ly participate in the activities essential 
to his own professional growth and im- 
provement? 

3. Does the teacher willingly and effective- 
ly participate in the activities essential 
to professional solidarity and welfare? 

The Teacher as a Member ofthe Community 

1. Doesthe teacher show concern over com- 
munity needs, plans, and activities? 

2. Does the teacher show evidence of un- 
derstanding, social needs and processes 
and the schools’ relation to these? 

3. Does the teacher foster democratic at- 
titudes and relationships ? 

4. Isthere evidence that theteacher has 
made a constructive contributionto com- 
munity welfare and development ? 


Each category has a number of sub-questions 
and a five point rating scale: outstanding; above 
average; average, below average and poor, 
There is a place for an overall generalmerit rat- 
ing on a five point scale and a place to indicate 
Strengths and weaknesses. The scale has had ex- 
tensive use. 

Another approach to criterion developmentis 
Manwiller’s (52) study of the expectancies of school 
board members regarding teachers. The subjects 
were 391 high school teachers and 134 members 
of boards of education. Among his conclusions 
are these: 


1. The areas of religious life seem to constitute 
the major area of intergroup agreement; the 
areas of economic andcivic life present agree- 
ment to a lesser degree; and the areas of per- 
sonal-family and social-recreationallife the 
least. 


2. Some differences of opinion were found in 
every school district between teachers and 
board members on the behavior theythought 
the community expected of teachers. 
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3. Morale, satisfaction, instructional efficiency, 
and the instruction of teachers depends upon 
more attention to teacher-community relation- 
ships. 


Studies such as this add new dimensions to 
criterion development. 

Erickson (24), Hellfritzsch (34), Lamke (46), 
and Schmid (70) attempted to clarify the situation 
with reference to criterion development thr ough 
the use of factor analysis techniques. Hellfritzsch, 
using data collected in cooperation with Rostker 
(66), Matthews (54), Rolfe (65), and Gotham (30) 
found common factors as follows; a) general 
knowledge and mental ability; b) a teacher rating 
Scale factor; c) personal, emotional and social 
adjustment; d) eulogizing attitude toward the 
teaching profession; e) possibly some aspect of 
intelligence, and f) a tendency toward research as 
contrasted with administration. Ina second fac- 
tor analysis he found the following common fac - 
tors: a) general knowledge and mental ability; b) 
a teacher rating scale factor: c)personal-emo- 
tional adjustment; d) a eulogizing attitude toward 
the teaching profession; e) a teaching ability fac- 
tor; and f) possibly a residual error. This analy- 
Sis adds several bits of information to our know- 
ledge. In the first place the findings for the two 
analyses provide parallel data from somewhat dif- 
ferent measures and a different population. The 
rating scale factor is again isolated andseems to 
be something apart from the other criteria. The 
relation of residual pupil gain seemsrelated to 
the teachers general knowledge and mental ability 
in one analysis, and an independent factor in the 
Other. The personal and emotional a djustment 
factor was present in both analyses. Studies such 
as these give a better insight into the structure of 
Criteria. 

Erickson (24) studies forty-two factors: a) 
nine estimates of teachi ng success made onthe 
basis of ratings by the principal,a state super- 
visor, peers, pupils, and a self rating; b) seven 
e Temperament 
S of personality based 
Sonality factors; and 
ice achievement. Each 
ures w ere factored sep- 
uded that if the factor 
factors) are considered 
uccess we find that 
' teachers and Seven 


etermined by composite one; 
ten **good'' and eleven **poor" teachers as iden - 


tified by composite two; and nine “6004” and: e- 
leven “‘poor’’ teachers are identified by composite 
three. He further concludes that the generally 
low intercorrelations among the several temper- 
ament, personality, and achievement measures 
throw doubt upon their use as measures of teach- 


er efficiency. He finally concludes that there was 


arately. The author concl 
scores (estimates of three 
as estimates of teaching s 
there are eight ‘good’ 
““роог?? teachers as d 


no general factor but three separate measures, 
each of which might be used separately in a pro- 
gram of differential prediction. Allof this seems 
to underline the difficulties involved in criterion 
development. | я 

Lamke (46), concluded that the responses 0: 
**good'' and **poor"' teachers did not fall into two 
well-defined andcharacteristic patterns as 
measured by the Cattell Sixteen Pers ona li ty 
Factor Test, but that several patterns exist for 
good teachers and probably several for po ör 
teachers. Schmid (70), using the Washburne So 
cial Adjustment Inventory, the Mooney Problem 
Check List, and certain scales of the Minnesota 
Multiphasic Personality Inventory found — 
patterns for male and female subjects. All Br 
these factor analysies serve to underline the com 
plexity of criterion development. . j= 

Besides the factor analyses, long time p 
low-up studies were made by Brandt (13) e 
Briggs (14). Brandt conducted a follow-up stu y 
of four prior studies made three to Six years pr pA 
viously, to ascertain whether their findings mig” 
be reaffirmed in sucha follow-up study. The 
studies investigated were those of LaDuke (45), 
Rostker (66), Jones (42), and Lins (49). The s 
terion under particular scrutiny was the MEPE 
ratings. A follow-up was made for the four stu : 
ies separately. While the correlations were e 
high, in each instance the predictions improve 
with time. The author believes that whatever the 
M-Blank measures it represents something fair 
ly well established in our professional RENEE: i 

Briggs (14) made a ten year follow-up stu У 
of the 1943 group studied by Lins and others (49). 
Using the Principal ratings as the criterion á 
found among other things that none of the pec 
ures used in the earlier studies correlated wit 
principals rating sufficiently to have predictive 
values. On the surface his findings seem to be 
in conflict with those of Brandt (13). 


Conc luding Remarks 


Each investigator has defined his problem 
and criterion of teacher effectiveness according 
to his interest and perception of the problem: 
Most of the studies employ a global sort of cr} И 
terion; some employed а more restricted crite- 
rion. Yet other investigators may have other а 
terests and perceptions of the problem. Thes t 
interests may be of several types: a) The interes 
of the investigator may be in the evaluation НӘ 
prediction of teacher effectiveness in particula 
Situations, as for example, a superintendent O 
Schools, b) The interest of the investigator may 
be in general teaching ability ina selected ar- 
ea of subject matter specialization, i.e., the 2 
bility to perform effectively in a variety of situa~ 
tions with different sorts of pupils with differen 
needs; and c) the interest of the investigator may 


be in the measurement and predictions of teach- 
er effectiveness in attaining some limited goalor 
goals of learning and in teaching in specified sit- 
uations with particular types of pupils. Thereare 


many combinations of these things. 


The investi- 


gator should be clear as to his concernand the 
criterion appropriate to his problem. 


1, 


Whatever the investigator’s concernthereare 
various criteria that one may employ. Those 
most frequently employed inthis series of in- 
vestigations are: a) Ratings of teacher effi- 
ciency based upon the observation of teacher 
behavior made by a single individual orby 
several individuals and by different sorts of 
persons: superintendents, principals, super- 
visors, college professors, students, and 
peers; b) Scores on tests of qualities, abili- 

ties and competencies thought to be associated 
with teacher efficiency; and c) Products, usual- 
ly residual pupil gain after the effects of non- 
teacher effects have been randomized or taken 
into consideration by regression techniques. 
Each has its strengths and weaknesses. 


slightly different point of view it can 
eene that oes are different Ways of de- 
scribing teacher efficiency and thus. in this 
sense different approaches tocriterion devel- 
opment. a) one might study the qualities of 
the persons thought to be essential to teacher 
efficiency; b) one might study teacher and pu- 
pil behavior; c) one might study the psycholog- 
icalprerequisitesto teacher efficiency; 
knowledges, skills and attitudes; andd) one 
might study the product, pupil growth and a- 
chievement, and other effects. Each of these 
has its particular strengths and weaknesses. 


iteri lopment one employs various 
eS eis icc devices, and the choice 
and validation of data gathering devices canbe 
made with varying degrees of sophistication. 
The essential steps for the validation of data 
gathering devices are pretty well set forth m 
the literature on measurement and test c on а 
struction. The investigations here еа 
showed varying degrees of sophistication in 


this respect. 
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The criteria of these investigations are fre- 
quently composite criteria. The bu ilding of 
composites presents many problems. First 
of all there is the matter of whether to com- 
posite or not composite a given set of scores. 
Aside from the fact that a composite may not 
Serve ones purpose there is the problem of 
non-additive scores that will appear in the 
consideration of certain data. The non-addi- 
tiveness arises first out of theabsence of zero 
points on our measuring scales and further, 
out of theories of structuring human abilities. 
Then if one does addthere will be the problem 
of the weighting of components and calculation 
of the resulting error of measurement. 


The statistical treatment of data can vary 
greatly. Inthis series of studies a very 
great variety of statistical techniques were 
employed ranging from the very simplest a- 
rithmetical calculation to the most compli- 
cated statistical treatment. In general there 
is an absence of sampling techniques. This 
was thought not inappropriate since the stud- 
ies were in the main exploratory and studies 
of total population of students for the most 
part graduatedfrom the University of 
Wisconsin. 


In examining the various criteria of effective- 
ness employed in these investigations, 
one observes the usual discrepancies between 
theory and practice. Some give very close at- 
tention to one aspect of criterion development 
and forget another, or consider it less impor- 
tant, or just run out of time, or mone y, or 
energy. 


Obviously, prediction studies are no bet ter 
than the criteria employed or the data gather- 
ing devices with which the data are collected. 
Carefully defined populations, carefully cho- 
sen data gathering devices, well thought out 
research designs, sophisticated statistical 
treatment of data, andwell developed criteria 
are essential to good research in this, as in 
other fields of research. 
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CHAPTER III 


THE METHODOLOGY OF THE INVESTIGATIONS HERE SUMMARIZED 


A. S. BARR 


The investigations here sum marized em- 
ployed a very great variety of data-gathering de- 
vices, research designs, and statistical proced- 
ures. In general, these investigations are ex- 
ploratory, descriptive investigations conducted 
withreferenceto a rather definite set of purposes. 
Avery large number of these studies were fol- 
low-up studies undertaken asa part of the teach- 
er education program atthe University of Wiscon- 
Sin. Over a period of many years the University 
of Wisconsin has been interested in the develop- 
ment of better programs for the education of 
teachers. One way to improve such programs is 
to conduct careful studies of the product. Many 
institutions have conducted such follow-up studies. 
Some of the studies here summarized were quite 
elaborate, while some were fairly simple, de- 
pending mostly upon questionnaire data. Follow- 
up studies are frequently criticized for their su- 
perficiality but they need not be necessarily so. 
They can be, and need to be on occasion, as com- 
plicated as the science of education itself. As 
follow-up Studies, the studies here summarized, 
dealt almost wholly with total populations. 

Another fairly constant purpose running 
through these studies arises out of a need that 
those preparing and administering admission pro- 
grams, teacher education programs, placement 


programs, follow-up programs, and in-service 
teacher educatio 


reliable information 


sites, built partly upon 
tradition that need to be checked, ‘~~ 
S Which say in effect that 
standards are poor risks 
admitted to the Program of 
teacher education. Teacher educators say, at 
least in the case of required courses and curricula, 


that these courses and curricula are a necessity 


and students doing well in these will do better as 
teachers than those not doing so well or not pun 
ing such courses. These are predictions an 
these predictions need to be checked. чени 

officials and employing officials must not only 
know what a good teacher is but must know how 
to identify one and predict her future efficiency- 
In-service teacher educators have similar needs. 


The Methodology of These Investigations 


In keeping with the general long-time gonis 
of this series of investigations, these studies аг 
mainly descriptive. Within this frame of PRIME 
ence a variety of the more conventional arene 
types of research designs were employed. Thes 
seemed to serve the exploratory character O 
these investigations adequately. Тһе sam Dime 
types of research have been reserved for {шыл 
research. This course was not followed becaus" 
of a lack of appreciation of these newer multivar- 
iate sampling techniques (asa matter of fact, t^ 
writer has taught such acourse for many TEMA 
but from a deepconvictionthat the intelligent M. 
of these depends not merely upon their mathemat- 
ical foundations, but needs to be preceded by ех 
perience with the thought processes of researc 
a better appreciation of what the problems a 
that need to be solved, theoretical orientation 2 
the psychology of learning andteaching, and fir$ 
hand knowledge of teacher and teaching. a 

Many of these studies were status studies, 
not inthe sense of something superficially studie: 
but in the sense of studies that sought to find e 
what exists. Most studies in psychology and € 
ucation are in a sense status studies. Sampling 
studies are for the most part status studies, i'9 
insofar as they use information about samples in 
draw inferences about the status of something ‘a 
a defined population from which the sample i 
drawn. z 

A large amount of time was spent on thes 
studies in attempting to learn more about the con^ 
stituents and concomitants of teacher effective” 
ness. Among the status studies are some eis! 
or ten questionnaire surveys. Doane (18), Mitchel 
(56), Goldgruber (28), and Schwahn (71), for ех” 
ample, conducted studies of the course requir?” 
ments and needs of teachers in undergrad u айы 
teacher education programs. Kline (43) studie 


the annoyances and satisfactions attending teach- 
ing; Manwiller (52) studied the expectancies of 
school board members with reference to the per- 
sonal lives of teachers; Martindale (53) and Knox 
(44) studied the situational factors that appeared 
to be related to job satisfaction; Eustice (25) 
studied the experience background of teachers and 
its relation to teacher effectiveness; Golden (29) 
studied the prerequisites to teacher effectiveness 
through the use of the critical incidence tech- 
nique; and Mann (51) conducted a follow-up study 
of University of Wisconsin graduates to ascertain 
their after-graduation successes and failures, 
These studies have beencatalogued as ques- 
tionnaire survey studies, but others may prefer 
other designations. For many persons an instru- 
ment to be called a questionnaire must be super- 
ficially and hurriedly prepared by an educational 
novice; but they neednot be so. The data-gather- 
ing devices employed in these investigations re- 
gardless of whether they lived up to expectation 
were careful prepared. The data-gathering 
device used by Goldgruber (28) and Schwahn (71), 
for example, was prepared by a statewide com- 
mittee, after a careful survey of the literature, 
and one full year of committee effort. The chief 
data-gathering de vice employed by Eustice (25) 
is designated a Data Booklet. This booklet, some 
twenty pages in length, was the subject of study 
by a seminar group throughout the greater part 
of an academic year. It contains questions about 
many of the things that people have asked about 
teachers in past investigations. Most of the in- 
struments employed in these investigations were 
` of a highly structured sort, put into writtenform, 
with carefulattentionto coverage, to the wording 
of questions, and to the likelihoodof getting ac- 
curate information. Some would not call these 
and other similar dat a -gathering devices ques- 
tionnaires, but the studies were status studies, 
k emt other normative survey types of 
investigations that proceded somewhat different- 
ly. Barr and Emans (7), for example, analyzed 
209 teacher rating scales to ascertain what those 
constructing such scales would have those who 
use them look for in teacher evaluation; Fleming 
(27) examined certain issues of wide circulation 
in the concerns that the 
news papers to ascertain Thiede (76) 
public might have about teac h ers. : ics 
studied the undergraduate achievem St sed 3 
of students enrolled inthe several schoo запа ta 
leges at the University of Wisconsin. iol social 
and Eichstaedt (22) compared the mental, и 
and emotional characteristics of students enro пе I 
in other schools and colleges of the сея 
Guiles (32) studied the practices, conditions, an 
trends in the Wisconsin State Teachers Colleges 
in relation to functions; Lien (48) studied the stu- 
dents enrolled in the four curricula in the State 
Teachers College, Whitewater; Nemec (58) 
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studied the relation between teacher certification 
and teacher education in the state of Wisconsin; 
Russell (68) studied the intellectual and affective 
characteristics of experienced teachers pursuing 
a masters degree program in teacher education; 
Stevens (74) and Johnson (38) studied the attitude 
of high-school seniors toward teaching as a career; 
Vertein (80) studiedthe personal, social, and in- 
tellectual characteristics of undergraduates en- 
rolled in courses for teachers at the Wisconsin 
State College, Platteville. 

There were a limited few experimental 
studies. Draves (21) studied class size and in- 
structional methods inrelationshipto certain stu- 
dent characteristics; Emans (23) and Von Eschen 
(81) studied programs for the in-service educa- 
tion of teachers; Lange (47) studied concept de- 
velopment by students enrolled in certain under- 
graduate courses in psychology and practice teach- 
at the University of Wisconsin, and Pitts (59) 
studied the effectiveness of different methods of 
organizing and directing student ex pe riences іп 
practice teaching. 

Many of the studies pertained to the validity 
and reliability of various instruments, and pur- 
ported to measure teacher effectiveness. Barr 
(8), Torgerson (78), Lyons (50), Johnson (39), and 
Walvoord (83), working as ateam, studied the 
validity and reliability of a large group of meas- 
ures; Rieck (62) and Flanagan (26) studied the ap- 
plicability of the Minnesota Multiphasic Personal- 
ity Inventory to undergraduates enrolled at the 
University of Wisconsin; Jackson (36) constructed 
and validated a social proficiency scale; Mathews 
(54) made an item analysis of certain measures 
that purported to measure teacher effectiveness; 
Reitz (61) studied the intelligence of students en- 
rolled in teacher education programs, and Rudi- 
sill (67) developed a scale for measuring the 
teacher's personality. 

A number of the studies were concerned with 
the classroom behaviorofteachers. Barr (3) and 
Jayne (37) made detailed studies of the verbal be- 
havior ofteachers. Tiedeman (77) studied teach- 
er-pupil relations; Brookover (12) studied the re- 
lation of certain social factors to teacher effec- 
tiveness. Bollinger (11) studied the social impact 
of teachers upon pupil character and personality ; 
Singer (13) made a rather complete survey of the 
sociometrics ofthe classroom. Many of the 
studies linked the teachers’ classroom behavior 
to other measures of teacher effectiveness. 

A number of the studies contrasted the be- 
havior and other characteristics of good and poor 
teachers. Barr (3)andCarlson (16) employed the 
logical principle of double agreement in their re- 
search design in searching for the characteristics 
of good teachers. Lamke (46) and Jones (40) used 
this design as apartofa more inclusive research 
design involving the use of the discriminative 
function. 
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Several of the investigators used case studies 
incidental to other designs, but no investigator 
employed this method as the principle research 
design. Brandt (13) and Briggs (14) conducted 
long-time, in-service, follow-up studies. Many 
of the individuals were studied from three to five 
years, and some for longer periods of time. | 

A considerable number of these investiga- 
tions were of the multiple regression prediction 
type. The studies by Rostker (66), Rolfe (65), 
La Duke (45), Gotham (30), and Hellfritzsch (34) 
were ofthe pre-prediction type, i. e., the test 
scores in these studies were all obtained from in- 
service teachers. These studies were the fore- 
runners of the Lins (49), and Von Haden (82) 
studies in which the testing program started with 
the group when they were freshmen and continued 
throughout the four-year undergraduate program 
and into their first years ofteaching. The Ander- 
son (1), Erickson (24), Lamke (46), Schwartz 
(72), Montross (57) studies were all of the multi- 
ple regression prediction type. There are other 
studies that make lesser use of regression tech- 
niques, 

The factor analysis technique was used ina 
number of the inve stigations. Hellfritzsch (34) 
compared the factor pattern of two sets of data; 
Schmid (70) compared the factor patterns of men 
and women teachers; Ringness (64) employed fac- 
tor analysis ina study of the reasons given by 
students for a choice of teaching as a major inter- 
est; Hampton (33) employed factor analysis tech- 
niques in analyzing the ratings of Iowa teachers; 
Erickson (24) used factor analysis techniques in 
the study of three criteria of teacher effectiveness. 
Lamke (46) used factor analysis techniques in the 
study of the personality characteristics of teach- 
ers, andJones (40) used factor analysis as an ad- 
junct to her use of the discriminative functions. 

Accordingly, then, a variety of research de- 
Signs were em ployed by the investigations here 
Summarized, mostly of the descriptive nonsam- 
pling type. In general, these investigations are 
of the type described by the early volume on re- 
search techniques such as the Good, Barr, Scates 
Methodology of Educational Research. The de- 


signs seemed quite adequate to the purposes of 
these investigations. 


As exploratory investiga- 
tions they probed almost all possibilities in light 
of the prevailing concepts of the times in which 
they were made. Each investigation was preced- 
ed by an extensive survey of the literature; each 
doctoral candidate was guided by a committee of 
three faculty members; each study represents a 
careful attempt at critical thinking. As such, 
even as a source of expert Opinion, these studies 
constitute an important source of hypotheses, 


facts, and materials for further research in this 
field. 


On the short end, there are many inadequacies 
in these studies that need not be repeated: 


1. Teaching is nowhere adequately defined. 
There are materials in these studies for such a 
definition but no definition is made. | 

2. The aggregate of vocabulary employed in 
these investigations is overwhelmingly extensive. 
Some of this vocabulary is defined, but most is 
used with the assumption that the current under- 
standing of these terms is adequate. | ў 

3. These investigations are, іп the main, o 
the uncontrolled variety. Such natural events in- 
vestigations are needed but in the absence oí ate 
tificial controls, there must be a careful descrip- 
tion of events or measurement of important factors 
and influences. There was extensive measure- 
ment of factors but inadequate description of 
events. > 

š t Many of these studies were correlation 
Studies. Nowhere does there seem to be recog- 
nition of the fact that coefficients of correlations 
cannot be taken at face value. " 

5. While many of the criteria were mos 
carefully defined and developed, many of Е 
studies employed efficiency rating which does по 
constitute an adequate criterion of teacher effec- 
tiveness even though it must be accepted as ade- 
quate if the investigators' interest is in the Su- 
perintendents' evaluation of teachers. on 

6. These investigations, generally ppan pE, 
accept the current elementalist factor concept t 
the constituents and concomitents of teacher er 
fectiveness. They may be quite correct but this 
possibly needs further investigation. 


The Teachers Studied 


The choice of subjects for the series of studies 
herein summarized was closely tied to the pur- 
poses of theseinvestigations. Many ofthe studies 
were, as has already been said, follow-up studies 
of graduates of the University of Wisconsin un^ 
dertaken to gain more information aboutthe prod- 
uct, their successes and failures, and the factor$ 
contributing to their effectiveness. These Uni- 
versity of Wisconsin graduates were a highly se- 
lected group, According to admission policies; 
these prospective teachers were first of all from 
the upper half of the high-school class from which 
they were graduated and from those who had 
Scores above the median on the Henmon-Nelson 
Psychological Examination. They were also rec- 
ommended by the principal of the school from 
which they weregraduated. Further restrictions 
Were placed upon the group at the time of their 
admission to the Schoolof Education at the begin- 
ning of the junior year. Undera System where 
the grade point average was determined by weights 
where an A received a weight of 3, Ba weight of 
2, C a weight of 1, and D a weight of 0, each stu- 
dent was required to have a minimum 1.5 grade 
Point average, which was above the University 
average for all students. Because of admission 


restrictions the average grade point for School of 
Education Juniors and Seniors was somewhat 
above that of other schools and colleges of the Un- 
iversity. The major characteristics of this group 
as shown by Lins are summarized in Table I. 
Keeping in mind that there are two sorts of 
scores in Table I, namely T-scores and grade 
point averages, it can be seen that the means for 
the group were about one-half sigma above the 
mean for comparable groups. The mean of the 
T-scores and forthe grade point were around 
1.25. Many studies of the intelligence of profes- 
sional groups reported in the literature, for ex- 
ample, would place teachers below the college 
mean in intelligence. Not only is this group 
somewhat above the average of the University in 
these respects, but the range has been narrowed 
to about three sigmas, i.e., one andone-half sig- 
ma below and one and one-half sigma above the 
mean, Thus neither extreme is well represented. 
Not all studies were follow-up studies of University 
of Wisconsin graduates, but this group appears 
to be fairly representative of other university 
groups for the period of time encom passed by 
these studies. Comparative data provided by sub- 
sequent investigators appear to support the rep- 


entativeness of these data. и 
pu In a further study of the characteristics of 


enrolled inthe School of Education at the 
КМУ ЕНУ of Wisconsin, Thiede (76) found that 
the scores for women were significantly higher 
than those for men and that when the scores for 
women (there are at the University of Wisconsin 
more women than men certified to teach) were 
compared with those pursuing three other pro- 
grams, namely the Bachelor of Arts program, 
Home Economics, and joint majors between edu- 
cation and an academic field, of twenty-seven 
differences studied, twenty-two were in favor of 
the teacher education group (Table II). For the 
men, when compared with the Bachelor of Arts, 
School of Commerce, Engineering, pre -medics 
and the joint major groups, of thirty-five Yum 
ences calculated, nineteen were in favor of the 
teacher education group (Table Ш). ЕП 

The Wisconsin graduates уеге а аре 

groupinother respects. They were, = mire 
all first or second year secondary-sc ES vod 
ers employedby Wisconsin school Se om es 
and teaching, for the most part, in the s 


centra] part of the state. 
The fact that many of 


University of Wisconsin gra 
are highly selected groups should always be kept 


in mind. Generally speaking, as has — 
Said, the studies to be summarized are co Tele 
tional studies, andit is generally recognize! a 
restrictions on the range of talent tend to lower 
the size of the coefficient of correlation. Many 
of these teachers will also have met the minimum 
cut-off points for many of the measures applied 


these studies employed 
duates and that these 
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to them and for these we would expect the corre- 
lations to be low and to fluctuate around zero 
where the effects of particular variables have been 
largely eliminated through selection. In examin- 
ing the data it will be difficult to ascertain which 
zeros, or near zeros, arise from selective fac- 
tors and which arise from a no relationship situ- 
ation. A convenient illustration of this point will 
be found in the reported correlations between in- 
telligence and teacher effectiveness. Some would 
interpret the low correlations sometimes found in 
these and other studies as indicating no relation- 
ship between intelligence and teacher effective- 
ness (Table IV). There were many near zero 
correlations between intelligence and teacher ef- 
fectiveness found in the studies of University of 
Wisconsin graduates, but these groups were, as 
already said, highly selected in many respects, 
including intelligence. Under these circumstances 
many of the correlations between intelligence and 
the criterion scores would be expected to be near 
zero. In absence of convincing data to the con- 
trary, it will probably be best, however, to con- 
clude that teaching requires a reasonably high 
level of intelligence. Possibly a more fruitful 
approach might be made through studies of the 
kinds of intellectual demands placed upon teachers, 

If we may pursue this matter a bit further, 
Stoelting (75), ina study of selective devices em- 
ployed at the University of Wisconsin, found little 
to be gained in a more vigorous selection pro- 
gram than that now pursued. 

He concluded that ifthe minimum grade point 
average were increased from the 1.3, em ployed 
at the time of his study, to 1.5, earlier employed, 
the higher minimum would screen out 13 of 24 who 
were judged to be of less than average teaching 
ability but at the same time eliminate 31 who were 
rated average, 7 above average, and 1 rated su- 
perior. Nemec (58) found that over a ten-year 
period only 16 out of a total of 265 teachers who 
were denied acertificate to teach after а two-year 
probationary period studied were from the Uni- 
versity. Knowledge of subject matter was the 
least frequent source of difficulty and lack of pu- 
pil control the most frequent cause of trouble. 

Another group of studies were made with el- 
ementary teachers. While these groups were al- 
So selected ina sense, they were selected in a 
somewhat differentsense. They were from many 
different institutions, with a great diversity of 
training and experience, and heterogeneous in this 
sense, but a selectedgroupin that as experienced 
teachers considerable weeding out had already 
taken placethrough the operation of a great vari- 
ety of forces acting to eliminate teachers. They 
were further chosen, for their particular posi- 
tions, by superintendents that did not knowingly 
employ inferior teachers. Detailed data on the 
characteristics of these teachers will be found in 
the several studies. One group of studies, for 


26 


JOURNAL OF EXPERIMENTAL EDUCATION 


MAJOR CHARACTERISTICS OF THE TEACHERS STUDIED 
(As reported by Lins) 


TABLE I 


Characteristic 


Score 


Henmon-Nelson, Mental Ability College 
Norms (T-Scores) 


Rank, High School Class (T-Scores) 
American Council Psychological (T-Scores) 
Cooperative General Culture (T-Scores) 
Cooperative English Test (T-Scores) 
Cooperative Reading Test (T-Scores) 

Grade Point Average (Four Years) 

Grade Point Average (Junior-Senior Year) 


Practice Teaching (Grade Point) 


TABLE II 


Range 
4.9 - 73.3 
45.0 - 73.3 
38.7 = 78,3 
35.9 - 73.3 
43.2 - 73.3 
33.5 - 70.5 

1.25 - 3.00 
1.22 - 3.00 
1.00 - 3.00 


MEAN DIFFERENCES BETWEEN THE TEACHER EDUCATION AND THREE OTHER 


GROUPS FOR WOMEN 


Variable 


High-School Percentile Rank 
ACA Percentile Rank 

Earned Grade Point Average 
Predicted Grade Point Average 


Earned Grade Point Average 
Nonprofessional Subject 


Earned Grade Point Average 
English and Speech 


Earned Grade Point Average 
Science 


Earned Grade Point Average 
Foreign Language 


Earned Grade Point Average 
History and Social Studies 


BA Group Home Ec. Joint Majors 
+3. 76 +3. 09 + oth 
-7. 42 +4. 71 +1. 79 

.05 + .26 - .08 
. 004 + .07 + .02 
. 04 + .32 + .01 
.08 a IT + .01 
-19 $42 + «02 
.12 + .17 - .01 
.06 + .34 + .01 
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MEAN DIFFERENCES BETWEEN THE TEACHER EDUCATION AND FIVE OTHER GROUPS FOR MEN 


Variable BA Pre-Med. EE sc TC 
High-School Percentile Rank -4. 996 -6. 60 + .04 = „ӨЗ 410. 08 
ACE Percentile -3. 00 -7. 62 -7.11 -5.84 * 8.36 
Earned Grade Point Average 

All Subjects + .02 - .23 + .14 + .12 + .22 
Predicted Grade Point Average - .08 - .11 - .03 - .03 £ S 
Earned Grade Point Average 

Nonprofessional Subjects + .01 - .24 + .17 + .15 + .40 
Earned Grade Point Average 

English and Speech - .08 - .09 + .30 + .21 + .53 
Earned Grade Point Average 

Science + .11 - .56 + .02 + .09 + .07 

TABLE IV 
CORRELATIONS BETWEEN CERTAIN MEASURES AND FOUR CRITERIA OF 
TEACHER EFFECTIVENESS 
| Depart- Placement Practice 
In-service mental Bureau Teaching 
Ratings Ratings Ratings Grades 
ات ي مها‎ 
Henmon-Nelson Psychological . 314 - 216 ‚119 ‚094 
ACE Psychological apoa -163 -073 .026 
Cooperative Reading Test Scores . 056 . 240 .106 .059 
High-School Rank 2621 205 199 .237 
. 385 . 335 . 302 “315 


Grade Point Ave rage 
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example, by Johnson (39), Lyon (50), Torgerson 
(78), and Walvoord (83) used as their subjects 
teachers from five Wisconsin cities, namely, An- 
tigo, Lake Mills, Marinette, Marshfield, and 
Stevens Point, cities ranging, at the time these 
studies were made, in population from 2007 to 
13,734. These teachers were doubtlessly a se- 
lected group in the sense here discussed. There 
was also some drawing off of the most competent 
teachers by the larger communities of the state. 

The teachers employed in this particular 
study had an average of slightly more than ten 
years of experience, 35 percent had one to five 
years of experience, 31 percent had six to ten 
years, and 34 percent more than ten years of 
teaching experience. Of the sixty-six teachers 
studied, one had a single year of professional 
training, fifty-one were two-year normal school 
graduates, nine had three years of professional 
training, and five had four years of professional 
training. With respect to the institution from 
which they were graduated, and the amounts of 
their training and experience, they were a more 
diverse group than University of Wisconsin grad- 
uates, but in other respects they were a still se- 
lected group, that is, they were selected in re- 
Spects that probably have pertinency to this study. 

Studies by Rostker (66), Rolfe (65), LaDuke 
(45), Von Eschen (81), Gotham (30), Mathews 
(54), and Hellfritzsch (34), used overlapping 
groups of elementary-schoolteachers. These 
teachers were for the most part seventh- and 
eighth-grade teachers teaching in one and two- 
room rural schools. They were graduated prin- 
cipally from Wisconsin state normal schools most 
frequently with three years of professional edu- 
cation. They ranged from 20 years of age to the 
middle fifties. They had from zero to thirty years 
of teaching experience; and the ran ge for time 
Spent in their present position was from zero to 
thirty years. This was probably as heterogeneous 
a group as any investigated, at least in some re- 
Spects, and as such should supply sizeable cor- 
relations ifsucharetobehad. The findings from 
these studies appeared to differ from others, 
however, only in details. 

Some of the studies employedoutof the state 
Subjects. Hampton (33) studied graduates of Iowa 
State Teachers College, and Brookover (12) used 
only rural consolidated township high schools in 
twelve north central Indiana counties. Some of 
the interview and questionnaire studies were based 
upon even more diverse populations. 

In summary, then, while the groups studied 
were, for the most part, highly selected groups, 
taken individually and collectively, there was 
muchdiversity inthe groups studied, particularly 
in such mattersasage, training, experience, in- 
stitutions from which they were graduated, and 
the grades and subjects which they taught. 

One final comment should probably be made 


upon the subjects studied. Most of the studies 
herein sum marized are non-sampling studies 
based uponavailable populations. To some people 
this will seem bad, but the research designs em- 
ployed and earlier described seemed to be ade- 
quate to the pur poses of the investigations. As 
has already been said, in many instances the stud- 
ies involvedtotal populations, that is total for the 
concern of the investigators (this was particularly 
true of the follow-up studies), and, ordinarily, 
wherethereistime, money, and energy to collect 
essential data with adequate care, total popula- 
tion studies seem to be preferred. There is much 
confusion on this point. Sampling isa very HS 
powered instrument of research and needs much 
more understanding and use than it gets um) 
particularly when one is not able to study tota 
populations. But one observes instances where 
there was apparently the time, money, and energy 
to doacareful population study, but less compre- 
hensive methods were employed nonetheless, ро5- 
sibly because some one thought this a better ap- 
proach. Sampling need not always be employ 
regardless of needandpurpose. The studies her 
reported are almost without exception exploratory 
studies directedtoward very specific problems 20 
specified situations. For other important ee 
poses beyond those of the investigators, thes 
studies will be inadequate. Presumably, some 0 
these investigators will in time define new pur- 
poses and see important uses for sampling m 
niques in new investigations with more ambitio 
or inclusive purposes. Some investigators wi 
be unhappy about the absence of error formulae, 
but the errors of error formulae are, generally 
speaking, errors of sampling; as far as this autho 
is concerned, heis more disturbed by the number 
of instances in which standard errors and tests © 
statistical significance were inappropriately €m^ 
ployed. 

The question is sometimes asked: In the ab- 
sence of sampling procedures, how does one gen- 
eralize to future population? The answer is tha 
one makes statements about the future on the ba 
of the understanding and information about th : 
present and the completeness of the explanatio! 
that one is able to achieve. All sampling studies: 
as do all population studies, concern themselves 
With the present. Ifthere are not too many 
changes in conditions as one goes from the pres- 
ent to the future, and if one's information is rea- 
Sonably complete and accurate, one may engag® 
in prediction with the expectancy that the predic- 
tions may have validity for the future. 

In brief, then, taken as a whole, a very large 
number of experienced and inexperienced teacher 
were involved in these studies, coming from al 
socio-economic levels, but mostly from middle- 
class families. While both elementary- а 
Secondary- school teachers were among those 
Studied, the secondary-school teachers wer? 


mainly teachers of the academic subjects. While 
there was muchdiversity among the groups stud- 
ied, as groups they were in most instances high- 
ly selected groups. T hese facts should be kept 
in mind in the interpretation of the data. 


The Data-Gathering Devices Employed in 
the Investigations Here Summarized 


Much attention was given in these investiga- 
tions to instrumentation. A very great variety 
of data-gathering devices were employed in the 
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investigations here summarized. As a matter of 
fact, one of the purposes of these investigations 
was to ascertain what progress has been made in 
the identification of important characteristics of 
teachers. If the instruments employed in the in- 
vestigations are publishedor areotherwise avail- 
able, they willbe discussed in a succeeding chap- 
ter. Unpublished materials will be found as a 
part of the appendices of the original doctoral 
theses. Theinstruments variedgreatly as to val- 
idity and reliability. The details of these instru- 
ments are discussed in a later chapter. 


JOURNAL OF EXPERIMENTAL EDUCATION 
(Volume 30, Number 1, September 1961) 


CHAPTER IV 


DATA-GATHERING DEVICES EMPLOYED IN THE WISCONSIN STUDIES 


CLARENCE BEECHER 


This chapter was undertaken to provide in 
convenient form a list of the data-gathering de- 
vices employed іп the Wisconsin Studies of Teach- 
er Effectiveness with information about their va- 
lidity and reliability. These measuring devices 
include tests, rating scales, behavior records, 
check lists, questionnaires, interviews, and 
physical measurements of various sorts. 

A very large amountof effort during the last 
half century has gone into the study of ways of 
evaluating teacher effectiveness, and many data- 
gathering devices of various sorts have been de- 
veloped to assist in the processes of evaluation. 

An important and significant consideration 
underlying the study of teaching effectiveness is 
the development of valid, reliable, and objective 
measures of the teacher characteristics thought 
to be associated with effectiveness. The degree 
to which these measures are valid and reliable, 
and how well they serve the purposes for which 
they were constructed will affect the accuracy 
oc which teacher effectiveness may be evaluat- 
ed. 

The data-gathering devices here reported 
were used in relation to various criteria of teach- 
er effectiveness, Sevencriteriaof teacher effec- 
tiveness were em ployed in the summary of the 
data relative to the various data-gathering de- 
vices here reported. 

These categories were selected on the basis 
of their all-inclusiveness. They comprise those 
used both with teachers in-service and pre-teach- 
ing teacher education programs. The criteria 
were as follows: 


Criteria Abbreviation 
I. Inservice Rating ISR 
a. By the superintendent ISRst 
b. By the principal ISRp 
c. By other supervisory officials ISRsy 
d. By teacher educators ISRte 
e. By departmental personnel 


in areas of specialization ISRas 


f. By state departmental personnel ISRsdr 

g. Self rating ISRsr 
I. Peer Rating = 
II. Pupil Gain Score ti 
IV. Pupil Rating Pu 
V. Composite of Tests Scores 

from tests thought to meas- 

ure teaching effectiveness с 
VI. Practice Teaching Grades PT 
VII. Combination or composites 

of some or all of the above 

criteria C 


Only data-gathering devices used in ihe wa 
consin studies and for whichthere are data in а I 
lation to the criteria will be described. Tab fs 
indicates the frequency of use of the seven pee 
teria employed in studying the 104 data-gather 
devices. ted 

In the materials to follow, data are pee. in 
relative to 104 of the 182 measures employer 
the Wisconsin studies, namely those for W yen 
there are re ported correlations with the a i 
criteria of teaching effectiveness already lis ds 
Seventy-four of the objective and subjective me 
ures correlated . 36 or more with the indic ‘mae 
criteria. These are listed with an asterisk (*) 
side the enumerated measure in the left margin; 


in 
The following abbreviations were used 
Table II: 


— Rel 
Reliability of measure 
Reliability reported in manual, some- 


times inthesis, sometimes in Buros* N 
Reliability obtained from studies NG 
Reliability not given val 
Validity of measure 51 
Source of information cri 
Criteria 
Number of cases that measure N 

was validated against El 
Elementary division ec 
Secondary division 8 


*Oscar Krisen Buros, Mental Measurement Yearbook (New Brunswick, N. J.: Rutgers University press): 
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TABLE II 


SELECTED LIST OF DATA-GATHERING DEVICES EMPLOYED IN THE WISCONSIN STUDIES 
OF TEACHING EFFECTIVENESS 


Rel. Val. SI Cri. N 
Abilities to Organize Research Ma- 
terials; Revised Form, J. W. 
Wrightstone, Bureauof Publications 
Teachers College, Columbia Uni- 

versity .88 (M) ‚31 to.58 66 — Cpgs 24 
Adjustment Inventory, Student Form 
1934, Hugh M. Bell, Stanford Uni- 

versity Press .93 (S) 26. 66 10  ISRsr 3 

Average 423.0 10  ISRsr 5 

Score 34. 33 10  ISRsr 3 

-.040 42 ISRsy 48 

=, 272 42 PGS 32 

-.141 42 PGS 24 

-.234 42 PGS 12 

Part B -.186 42 PGS 32 
Agricultural Manipulative Skills In- 
formation, Department of Education 

University of Wisconsin NG -.116 to . 243 78 Рик 60 

-.180 to . 203 78 ISRp 60 

-.084to.283 78  ISRas 60 

-.151 to . 303 б c 60 
Almy-Sorenson Rating Scale for 

Teachers, Public School Publishing 92 (M) 

Co., Bloomington, Illinois 93 (S) 807 12 ISRsy 7 

‚105 12 ISRsy 12 

515to.817 39 CTS 60 

-.172to.079 39 Cpgs 66 

-.915to.473 39 CTS 66 

-.285, .243 45 PGS 31 

-. 239, - .005 45  Cpgs 31 

. 36 65 Cpgs 47 

10 to.34 66 Cpgs 24 
American Council Civics and Gov- 
ernment Test, Form B, World Book 

Co., Yonkers-on-Hudson, N. Y. . 82 (M) 1.50 to 9.25 15 ISR 57 

Mean / 8.52 15 PGS 57 

Gain © 4.5* 54 Cpgs 222 

-.01 65  Cpgs 4T 

. 29 to . 40 66 Cpgs 24 
American History Test, Form A 
1939-40 Edition, State High School 
Tests for Indiana, S. Provus and V. 
F. Dawald and State High School 

Test Committee .92 (S) -. 229 to .185 11 PGS 66 
Aptitude Test for Ele mentary and 
High School Teachers, J. E. Bath- 
hurst, F. B. Knight, G. M. Ruch, 
and F. Telford, Bureau of Public 
Personnel Administration, Washing- 

ton, D. C. - 79 (S) . 046 to . 786 39 CTS 66 


<<< 


ae ee < ©; = < < < 


ARELA 
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TABLE II (Continued) 


* 11 


* 12. 


13. 


Rel, 


Val. 


(No. 7 continued) 


Autobiography based on eight per- 
sonal qualities 


Audio Recordings 


Barr-Harris Teacher Performance 
Record, А. 5. Barr and А. E. Harris, 
Dembar Publications, Inc., 1943 


Battery of Alternation Tests on 
Flexibility, R. W. Kleemeier and 
F. J. Dudek, “A Factorial Investi- 
gation of Flexibility, ’’ Educational 
and Psychological Measurement, x 


(Spring, 


a) Two digit numbers, addition 


b) Two digit numbers, subtraction 


c) Two digit numbers, mixed flex- 
ibility 


Battery of Objective Type Measures: 
tempo, fluency, Spee d, suggesti- 
bility, disposition-rigidity, dexter- 
ity-coordination 


California Test of Mental Maturity, 
Intermediate Series, Grades 7-10, 
E. T. Sullivan, w. W. Clark, and 
E. W. Tiegs, California Test Bur- 


eau, Los Angeles 28 


California Test of Personality, In- 
termediate Series, Grades 7-10, 
Form A, W. W. Clark, E. W. 
Tiegs, апа L. P. Thorpe, Califor- 
nia Test Bureau, Los Angeles 28 


NG 
NG 


NG 

. 53 to. 88 
(S) 

‚18 (S) 

‚81 (S) 


. 88 (S) 


NG 


.94 (S) 


.932 (M) 


.163 to . 080 
. 191 to . 605 
.502 to . 417 


. 352 to . 223 
.924 


. 158 


. 484 
. 237 
. 463 
. 426 
. 383 
.133 
. 353 
. 403 


. 418 
. 206 
. 388 
. 389 


.02 to . 57 
.00 to . 47 


.06, .20 
.10 to .21 
. 05 

OB, „т 


49 


57 
57 


Cri N El Sec. 
Cpgs 66 v у 
CTS 66 v у 
PGS 66 wv у 
ISRp эз v и 
Cisrsy 41 У 
ISRte 54 ۷ 
c 46 У 
РТС 46 М 
ISRte 46 / 
ISRst 46 J 
c 46 J 
PTG 46 ۷ 
ISRte 46 š 
ISRst 46 ۷ 
C 46 š 
PTG 46 4 
ISRte 46 К 
ISRst 46 ۷ 
Cisr 34 / 
Cisr 26 v 
PGS 258 ۷ 
Cpgs 258 J 
PGS 90 / 
PGS 168 / 
ISRst 22 / 
ISRst 18 ۷ 
PGS 22 / 
ISRst 22 v 
PGS 22 у 
Cpgs 258 y 
PGS 258 v 
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TABLE II (Continued) 


ج 


Rel. 


* 15. 


16, 


* 17, 


* 18. 


* 19. 


* 20. 


* 21. 


(No. 14 continued) 


Confidential X Rating Form, State 
Department of Public Instruction, 
Madison, Wisconsin 


Cooperative General Culture Test, 
American Council on Education, 
College 1930-1951, Form XX, N.J. 
Blair et al, Cooperative Test Divi- 
Sion, Educational Testing Service NG (M) 


Cooperative Social Studies Test, 
American Council on Education, 
Grades 7, 8, 9, Form R, Agatha 
Townsend and Mary Willis, Cooper- 
ative Testing Service, 15 Amster- 
dam Ave., New York NG 


Creative Effort Tests of Disposition 
Rigidity, Raymond B. Cattell, A 
Guide to Mental Testing, University 
of London Press, 1953 NG 


2) Reverse strokes 
b) The Alphabet Tests 


Estimate of Teacher's Qualification, 
Form 6A Blank, Placement Bureau 


Iowa State Teachers College, Cedar 


Falls, Iowa .91 (S) 


General Category Rating Form, Iowa 
State Teachers College, Cedar Falls -T1 to .91 


(S) 
Giles Recitation Score Card, 


World Book Co., Yonkers-on-Hudson 
New York, 1925 . 89 (S) 


Val. SL. Cri. N El. Sec. 
. 00 63 PGS 90 v 
.29 63 PGS 168 v 
‚649 12  ISRsy 9 ۷ 
. 586 42  ISRst 14 y 

-. 275 42 PGS 33 y 
.034 42 ISRsy 50 v 

=, 228 42 PGS 30 : 

-. 194 42 PGS 26 

-. 583 42 PGS 13 | 

-.549to-.042 75 ISR 88 у 

-.161to .105 75  ISRsdr 88 ү 

-.133to .054 15 ISRte 88 : 

-.194to-.038 75 РТС 88 ү 

-.206to .003 75 С 88 
„21 63 ISRst 18 Ч 
.14 to . 24 63  ISRst 22 y 
.06 63 PGS 258 y 
.03 63  Cpgs 258 ү 

2,98, 68 63 PGS 22 
.270 4 c 46 ç 
. 016 41  PTG 46 И 
+236 41  ISRte 46 У 
. 368 41 ISRp 46 
. 07 to . 36 33  ISRst 97 v 
. 35 to .57 33  ISRst 59 dg 

-.15 to .11 33  ISRst 64 н 7 
-18 to . 45 33  ISRst 61 y 
. 34 to . 77 33 ISRst 61 v 
-.444 0.8129 39 CTS 66 { 4 
-. 322 to . 289 39  Cpgs 66 / Уу 


BEECHER 


TABLE П (Continued) 


35 


22. 


* 23 


* 24. 


25. 


* 26. 


27. 


28. 


29. 


30. 


31. 


Rel. 


Val. 


Grade point average, Freshman- 
Sophomore 


Grade point average, Junior-Senior 


Grade point average, major teach- 
ing field 


Grade point average, overall pro- 
fessional courses 


Grade point average, professional 
course 


Grade point average, professional 
less practice teaching grades 


Grade point average, university 


Grades, practice te aching 


Grades, practice teaching, Educa- 
tion Methods Course 


Grades, practice teaching, Educa- 


tion 75 


NG 


NG 


NG 


NG 


NG 


NG 


NG 


NG 


NG 


NG 


-.08, -.01 


.232 
-.112 
-.134 


-.01, -. 06 
.08, .00 


-.022 to .79 


09 


.06, .20 
.18, .12 


-. 061 to .276 
-.041 


.129, .276 


-. 306 


SI. 


Cri. N El Sec. 
ISRsy 50 " 
PGS 28 К 
РС5 10 / 
ISRp 69 у 
ISRsy 69 ۷ 
PTG 76 ۷ 
ISRsy 54 Vv 
PGS 30 v 
PGS 12 / 
€ 46 v 
PTG 46 у 
ISRte 46 v 
ISRp 46 ۷ 
ISRsy 72 š 
с 46 ۷ 
PTG 46 ۷ 
ISRte 46 ۷ 
ISRp 46 ۷ 
ISRsy 72 ۷ 
ISRp 70 ۷ 
ISRsy 10 y 
PTG 76 ۷ 
ISRsy 51 J 
PGS 32 v 
PGS 26 ۷ 
PGS 10 n 
ISRp 73 v 
ISRsy 73 4 
ISRp 76 | 
ISRsy 52 J 
PGS 28 ۷ 
PGS 13 4 
ISRp 64 " 
ISRp 61 d 
ISRsy 62 / 
ISRsy 58 ۷ 
ISRp 63 ۷ 
ISRsdr 60 y 
ISRsr 62 y 
PeR 56 / 
PuR 53 у 
ISRp 64 " 
ISRp 6l J 
ISRsy 62 У, 
ISRsy 58 / 
ISRp 63 v 
ISRsdr 60 ۷ 
ISRsr 62 V 
PeR 56 " 
PuR 53 4 
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Rel. Val. SL Cri. N El. Sec. 
* 82. Guide Sheet C, Teacher inn ge 
Research Committee, University o 37 у / 
Wisconsin (mimeographed) NG eu Ase = ISR? 46 V і 
. 981 42 ISRsy 54 i 
.166 42 PGS 19 / 
.281 49  ISRp 58 ү 
.558t0.810 49 Cisr 58 
* 33. Guilford- Zimmerman Temperament 
Survey, J. P. Guilford and W. S. 
Zimmerman, Sheridan Supply Co., . - en ai "m diá J 
Beverly Hills, California š ) e П Pie 46 ‘ 
. 436 41  ISRte 46 ү 
‚410 41  ISRp 46 
* 34. Henmon-Nelson Tests of Mental 
Ability, Forms A, B, C. V. A.C. 
Henmon and M. J. Nelson, Houghton / 
Mifflin Со., New York .90to.97(M) .115 42  ISRsy 31 y 
.87to.94(M) .017 42 PGS 28 7 
.128 42 PGS 16 И 
.400 42 PGS 6 d 
.314 75 ISR 88 M 
.216 "5  ISRsqr 88 / 
.119 75  ISRte 88 у 
. 094 75 PTG 88 J 
. 139 5 c 88 
* 35. Interviews NG / 
a) Composite interviews . 436 81 Cisr 58 / 
.162 81  PuR 50 ү 
‚354 81 PGS 17 
b) Eight qualities and the composite J 
for interviews . 067 to . 513 81 ISRte 58 J 
-.169 to .239 в рин 50 
-. 318 to .495 81 PGS 17 
* 36. Interview Digest on Eight Personal 7 
Qualities NG --002to.458 81 ISRte 58 / 
.121t0.439 81 Cisr 58 J 
-023to.411 81 Рив 50 ү 
-.386 (0,354 81 PGS 17 
* 37. Kuhlman-Anderson Intelligence 
Test, F. Kuhlman and R. Anderson, 
Fourth Edition, Grades VII- VIII, 
Personnel Press, Inc., (formerly 
published by Educational Testi ng J 
Bureau, Educational Publishers, -91 (0.95 (М) -. 358 to . 508 54  Cpgs 194 р, 
1953). .080 0.094 80 Cpgs 194 
* 38. Link Inventory Activities and Inter- 
ests, 1938 Revision, Grades 7-13, 
Henry C. Link et al, Psychological / 
Corporation, New York -73t0.88(M) . 360 42 ISRsy 49 у 
. 067 42 PGS 27 ү 
. 094 42 PGS 24 / 
-. 342 42 PGS 12 
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Rel. Val. SI Cri. N El. Sec. 

* 39. Michigan Education Association 
Teacher Rating Card, Michigan Ed- 
ucation Association, Lansing, Mich- 

igan .93 (M) .273 12  ISR 12 ۷ 

. 770 12 ISR 17 ۷ 

-.931 to . 857 39 CTS 66 ۷ v 

-.116 to . 161 99 Cres 31 У 

-. 346 to , 114 45 PGS 31 y 

-. 297, . 097 49 Cpgs 31 ۷ 

. 39 65 Cpgs 47 / 

.12 to . 31 66  Cpgs 24 / 
* 40. Minnesota Multiphasic Personality 
Inventory, Revised Edition, S. R. 
Hathaway andJ. C. McKinley, Psy- 
chological Corporation, University 

of Minnesota, 1943 .1to.83(M) -.567 to , 776 73 ISRsr 41 ۷ 
* 41. Morris Trait Index L, E. H. Morris, 
Public School Publishing Co. , 

Bloomington, Illinois . 824 (S) 2.56 15  PGS 57 / 

Mean f .18 to 4.68 15 ISRsy 57 ۷ 

Gain -.169 to . 441 39 CTS 66 voy 

-. 234 to . 069 39 Срез 66 f y 

-. 357 to . 198 50 PGS 66 ۷ ۷ 

0. 9% 54 Cogs 57 v 

-.17 65 Cpgs 47 4 

-. 03 to . 30 66  Cpgs 24 ۷ 
42. National Teachers Examination, 
Professional Information Section, 
1951 Edition, Educational Testing 

Service, Princeton, N. J. . 85 (M) 106 78 PuR 60 / 

. 0 78 ISRp 60 ۷ 

. 248 78 ISRas 60 ۷ 

. 202 78 ISRsy 60 / 

199 to . 290 78 с 60 / 
1 ew Standard Arithmetic Test, Form 
ы р T. L. Kelley, G. M. Ruch and 
L. M. Terman, World Book Co., 

Chicago, Illinois .71to.95 (M) -. 337 to . 326 50 PGS 66 í + 
44. Objective Tests of Primary Source 
Traits, Test 38a, Department of Ed- 
ucation, University of Wisconsin, 

mimeographed NG -. 32 to .28 72 PTG 24 ў 

-. 60 to . 31 72 ISRsy 34 ۷ 
45. Observation Scale for Rating Citi- 
zenship at Sc bool, Ver а, 
Bureau of Educational Rese dcm 

n ° š i NG 111.28 | Ave. 10  ISRte 21 ۷ 

iversity of Wisconsin 139, ales {0 тсе 1s ` 
* 46. Original Activity Analysis List of 184 
items describing observable teacher 
activities, C. D. Jayne, University 

of Wisconsin NG -. 98 to . 869 37 Cpgs 10 ۷ / 

-.41 to . 81 37  Cpgs 16 V 
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TABLE II (Continued) 


Rel. Val. SI Cri. N El. Sec. 
v 
i =. 75 to -.19 37  ISRsy 22 
MENSES -.66to .86 31  PGS 10 ү , 
-.31to .42 37 ISRsy 10 E 3 
P=-.08to.20 37  ISRgy 17 


47. Orientation Test Concerning Funda- 
mental Aims of Education, A. S. 
Lewerenz and H. C. Steinmetz, Cal- 
ifornia Test Bureau, Los Angeles, 


J 
57 
Kandi. .89 (M) 6. 68 15 PGS И; 
California Mean/T1. 12 to 15.31 15 ISRsy a d 
Gain 0% а CMS 1 y 
-. 06 65 Cpgs Ji 
.23 to .35 66 Cpgs 24 
* 48. Paired Comparison Rating Scale, 
N. D. Hampton, Iowa State Teach- 61 J 
-T1to.87(S) -.33 to .51 33  ISRst 
ers College, Cedar Falls (S) ——— 33 ISRet 6l N 
* 49. Paired Comparison Rating Scale, (S) 
Reasons for Choice of Teaching as -64to .93 16 / 
a Profession, Department of Educa- -40 0.88 -. 447 to . 416 64 Cisr 8 J 
tion, University of Wisconsin -. 386 to . 362 64 Cisr 1 
* 50, Participator Rating Scale, Depart- 
ment of Education, University of 16 / 
Wisconsin (mimeographed) NG . 524 to . 741 3 ISRte 
* 51. Peer Evaluation Form, adapted 
from Student Reaction to Instruction 
Questionnaire, Roy C. Bryan, 
Western Michigan College of Educa- j 
tion, Kalamazoo, Michigan NG . 40 2  ISRsdr 30 
* 52. Pennsylvania Teacher Rating Score 
Card, Com m onwealth of Pennsyl- 
vania, Department of Public In- 
Struction, Harris burg, Pennsyl- . / 
уаша .92 (S) "e ш E ME v Y 
7.060t0.231 39 Cpgs 66 / 
53. Percentile Rank, High School NG -.07 24  ISRp 60 ү 
-.04 24  ISRp 57 
/ 
. 06 24 ISRsy 58 / 
.14 24 ISRsy 54 J 
-.17 24 ISRp 59 J 
-. 01 24 ISRsdr 58 у 
-. 06 24 ISRsr 59 J 
-.10 24 PeR 53 у 
x 24 PuR 49 
* 54. Personal Health Standard Scale, 
T. D. Wood, Bureau of Publications, 
Teachers College, Columbia Uni- 
versity NG -.508 0.1355 39 CTS 66 


/ y 
-176 to .453 39 Cogs 66 / j| 
-.32410.461 50 pas 66 v 
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Rel. Val. SI Cri. N El. Sec. 

* 55. Personality as measured by an in- 
formalten-point scale for rating 
personality. Drawn from Common- 
wealth Teacher Training Study and 

other sources NG -. 006 to . 589 39 CTS 66 V V 

-. 256 to . 602 39 Среѕ 66 У v 

-. 482 to . 674 50 PGS 66 v ۷ 
56. Personality Inventory, R. G. Bern- 
reuter, Stanford University Press 

California .85 0.92 11. 6% 54 Cpgs 152 v 

(Bn) Neurotic Tendency (M) 65. 74 15 PGS 57 ۷ 

Mean f |4. 37to 29.50 15 ISRsy 5" / 

Саїп -.14 30 CTS 72 ۷ 

06 to .17 30 CTS 72 y 

-.14 65  Cpgs 47 ۷ 

-. 32 to -. 08 66 Cpgs 24 У 

(Bs) Self-sufficiency Mean J6. 75 15 PGS 57 / 

Саїп . 43 to 12,50 15 ISRsy 57 ۷ 

-.11 30 PGS 72 / 

-. 01 to .19 30 CTS 72 ۷ 

-.11 65 Cpgs 47 ۷ 

-.20 to .27 66 Cones 24 / 

(Bd) Dominance-submission Mean үн, 82 15 PGs 57 J 

Gain [.31 40 30.79 15  ISRsy 57 ۷ 

. 04 30  PGS 12 v 

.09 to .21 30 CTS 72 ۷ 

. 04 65 Cpgs 47 / 

=. 16 to . 34 66 Cpgs 24 ۷ 

(Fc) Flanagan self-confidence -. 29 to .07 66 Cpgs 24 ۷ 

(Fs) Flanagan sociability -. 30 to . 09 66  Cpgs 24 ۷ 
57. Personality Rating Scale, A. S. Barr 
et al., Department of on tee Un- 
iversity of Wisconsin (mimeo- 

graphed) .30 65 Ср 4" / 
ü ey Diagnostic Reading Test, 

58. M 4 o ên: ‚10 37 PGS 95 ДИ] 
al Information as meas- 
wee Proll" plished test construct- 
ed by T. L. Torgerson, University 

of Wisconsin, 1930 . 77 (S) -. 373 to .126 39  Cpgs 66 $ X 

-. 387 to . 774 39 CTS 66 / у 

-. 420 to . 653 50 PGS 66 f $ 
* 60. Psychological Examination for Col- 
lego Freshmen, American mien 
on Education, L. L. Tuc 
T. G. Thurstone, Editions 1929, 
1936, 1945, 1948, Lp amem i e 

Division, Educational NG (M) -.01, -.10 3  ISRp 55 / 

уїсе -.01, -.08 3  ISRsy 55 / 

. 002 3 PTG 16 / 

. 082 13  ISRp 35 Vox 
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Rel. Val. SI Cri 
i 2an 3.5 15 PGS 
(No. .BO continued) Lek js 8710 42.75 15  ISRsy 
.08 24 — ISRp 
-.18 24 ISRp 
=, 10 24 ISRsy 
. 06 24 ISRsy 
ERES 24 ISRp 
.10 24 ISRsdr 
. 04 24 SRsr 
-.09 24 PeR 
-.07 24 PuR 
-.340to .641 39 CTS 
-.353to -.001 39 Cogs 
. 099 42 ISRsy 
-. 256 42 PGS 
. 046 42 PGS 
-.243 42 PGS 
. 020 to . 489 45 PGS 
- 425 to . 611 45 Cpgs 
-.176, -.124 45 Cisr 
-.518 to . 312 50 PGS 
= ft 65 Cpgs 
.25 to .58 66 Cpgs 
x dp. PupilQuestionnaire, Wilbur Brook- 
over, Indiana State Teachers Col- 
lege NG -.39 to . 61 11 PuR 
-.20 to .15 11 PuR 
-. 22 11 PGS 
* 62. Pupil Reaction Instruction, H. M. 
Anderson, Department of Education 
University of Wisconsin . 30 2 ISRsr 
.38 2 PeR 
. 22 2 ISRsdr 
565 73 Cisrsy 
* 63. Ranking Question naire, Belief of 
Advantages of Various Occupations, 
Department of Education, University 
of Wisconsin NG -.450 to , 619 64 Cisr 
-.451 to . 448 64 Cisr 
64. Right Conduct Test, H. A. Wood, 
Grades 7-12, Hillsdale School Sup- 
ply Co. , Hillsdale, Michigan, 1936, NG a A 10 PuR 
Mean 90. 92 
Gain 90. 39 10 кше 
Scores | 2.083 10 PuR 
1.018 
9.20 10 ISRsr 
97. 33 10 ISRsr 
„93, 5.35 63  ISRst 
415, „21 63 PGS 
-20 63 Cpgs 
. 04 63 PGS 
. 32 63 PGS 
.01, .35 63 PGS 


BEECHER 


TABLE II (Continued) 


41 


Rel. Val. SI Cri. N El. Sec. 

* 65. Rudisill Scale for the Measurement 
of the Personality of Elementary 
Teachers, M. Rudisill, University 

of Wisconsin. Unpublished. .33 (S) -.19 to . 60 30  PGS 72 Р 

v 

-.10 to .17 30 CTS 72 V 
* 66. Safeguarding Public Health, C. J. 
Daggart and class in test construc- 
tion, WisconsinState Teachers Col- 

lege, Whitewater NG .11 to . 37 66 Ср 24 Vv 
* 67. Scale for Evaluating Personal Fit- 
ness of Teachers, W. W. Charters, 
Ohio State University, Columbus, 

Ohio (mimeographed) . 46 -. 08 30 PGS 72 J 

.14, . 87 30 CTS 72 ۷ 

. 35 65 Cpgs 47 Vv 
* 68, Scale for measuring the attitude to- 
ward any teacher, Form A, direct- 
ed and edited by H. H. Remmers, 
Division of Educational Reference, 

Purdue University . 90 (M) 8. 89 10 Cpur 245 Y, 

Mean 8. 80 10 Cpur 90 / 

Gain 8. 86 10  Cpur 70 V 

. 05 63 ISRst 22 V 

.02 to . 07 63 PGS 258 / 

-.10, .48 63 PGS 22 / 

.28 63 ISRsy 22 ў 
* 69. Scale for measuring the attitude to- 
ward teachers and teaching profes- 
sion, Tressa C. Yeager, Bureau of 
Publications, Teachers College, 
Columbia University (mimeo- 

graphed) .88 (M) { 2. 62 15 PGS 57 г: 

Mean / .12 to 2.50 15 ISRsy 57 Y 

Gain“ -.198, -.003 45 PGS 31 / 

-164 45  Cpgs 31 / 

-.154, -.104 45 on 31 К 

11.1% 54 Cogs 45 у 

.22 65  Cpgs 47 

-.03 to . 47 66 Среѕ 24 / 
* 70. Scale for rating certain acoustic fac- 
tors of speech by auditory impres- 
sion - reading. University of Wis- 

consin (mimeographed) NG Ш K to . 80 99 Cisr 40 / 

. 41 to . 48 55 Cpgs 40 у 
* 71, Scale for rating certain factors of 
speech by auditory impression- 
speaking. University of Wisconsin 

(mimeographed) NG s d to . 81 55 Cisr 40 J 

.25 to . 42 55 Cpgs 40 g 
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TABLE II (Continued) 
Rel. Val. SI CH, N El. Sec. 

72. Scale of Civic Beliefs, Forms A, B, 
J. W. Wrightstone, Institute of 
School Experimentation, Teachers 

College, Columbia University ‚94 (M) 10.57 15 PGS 97 ү 

5.81 to 16.43 15 ISRsy 57 У 

5.6% 54 Cpgs 160 у 

‚29 65  Cpgs 47 v 

* 73. Scale on Eight Personal Teacher / 

Qualities, mean of 8 qualities NG . 288 to . 451 81 Cisrgy 58 i 

.070t0.239 81 рин 50 ү 

-.046 0.1820 81 PGS 17 у 

.275t0.401 81 Cisrsy 39 / 

.205to.357 81 Рив 32 y 

-.139 to . 271 81  PGS 14 / 
* 74. Schutte Scale for Rating Teachers, 
World Book Co., Yonkers-on-Hud- 

son, New York . 92 (S) -. 383 to .891 39 CTS 6 у У 

-.059t0.154 39 Cpgs 66 v У 
* 75. Sims Score Card for Socio-econom- 
ic Status, Form C, V. M. Sims, 
Public School Publishing Co., 

Bloomington, Illinois .94 (M) 1. 68 15 PGS 57 У 

18 to . 93 15  ISRsy 57 ç 

-.15 6 Срез 47 / 
* T6. Sixteen P. F. Test, Forms A and B, 
Raymond B. Cattell, Institute of 
Per sonality and Ability Testing, 

Champaign, Illinois .1to.93(M) -.21 о .28 24 ISRp 64 У 

50to.88(8) -.29 0.20 24 ISR) 6 | 

-.21 to .26 24  ISRsy 62 y 

-.25 to .23 24  ISRsy 58 / 

-123 to .28 24 — ISRsy 63 У 

-.27 to . 36 24  ISRsar 60 У 

-. 2T to . 38 24  ISRsr 62 У 

-. 23 to . 21 24 PeR 56 / 

-.32 to . 25 24 PuR 63 J 

-. 21 to .27 57 Cisr 35 / 

-.11 to .40 5" Cisr 25 y 
* 77. Social Adjustment Inventory, Sapich 
Edition, J. N. Washburne, Syracuse 

University .92 (M) 335. 07 10  PuR 245 / 

Average 4342.49 10  PuR 90 J 

Score 329. 66 10 PuR 70 J 

1.18(C.R.) 10 PGS 245 / 

-53(C.R.) 10 PGS 90 v 

-45(C.R.) 10 PGS 70 / 

Average 376. 80 10  ISRsr 9 У 

Ѕсоге 86. 6 10 1585г 5 / 

353.33 10 ISRsr 3 y 

Mean Gain ` 8.86 15  PGS 57 / 

Mean Gain 16.18to26.50 15  ISRsy 57 / 
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Rel. Val. SI Cri. N El. Sec. 
(No. 77 continued) .06 30 PGS 57 " 
.40 to . 52 30 CTS 57 ۷ 
4. 2% 54 Cpgs 144 / 
‚24 63  ISRsy 22 ۷ 
-.02 to . 18 63 PGS 258 / 
-.09 63 Cpgs 258 ۷ 
.10 63 PGS 90 ۷ 
. 38 63 PGS 168 ۷ 
. 02 63 PGS 22 / 
-.00, .24 63 ISRsy 22 ۷ 
-. 44, .04 63 PGS 22 / 
-.07 to .17 66 Cpgs 24 К; 
* 78. Social Attitude of Secondary Teach- 
ers, G. W. Hartman, Teachers 
College, Columbia University .94 
(mimeographed) . 93 (S) 7.81 15 PGS 57 ў 
6. 50 to 7. 87 15  ISRsy 57 v 
5. 8% 54 Cpgs 206 ۷ 
.01, .38 65 Cpgs 4" / 
21 to .52 66 Cpgs 24 a 
* 79. Social Intelligence Test, George 
Washington University Series, 
Grades 9-16 and adults, 1930, I 
Form. F. A. Moss, T. Hunt and K. 
T. Omwake, Center for Psycholog- 
ical Service, George Washington . 88 (M) 
University .89 (M) . 086 to . 507 39 CTS 66 voy 
-. 073 to . 109 39  Cpgs 66 y qw 
-.294 to . 536 50  PGS 66 V у 
80. Social Proficiency Test, Virgil D. 
Jackson, in The Measurement of 
soria. peona ' cwm roo 82 (S) 327 to -.016 45 PGS 20 / 
1 оп A à -. -. 
perimental Education, -1 365, -.354 45 С 20 М 
-.131, -.0064 45 Cisr 20 ۷ 
* ecial pronunciation Test on 
81. Words, University of Wisconsin т m à , 
(mimeographed) NG - 46 55 Cisr 0 
, pgs 40 / 
1 Test - Speech 
A Special Pros Wisconsin NG ‚011 75 ISRsy 88 y 
. 253 "5 ISRsar 88 ۷ 
. 069 "5 ISRte 88 / 
.221 7% РТС 88 ۷ 
.179 5 C 88 / 
83. Stanford Educational Aptitude Tast 
M. B. Jensen, stanford University 85 (M) 
ETERS Mean [ 4.94 15  PGS 57 " 
TA Gain (10.56 to 47.00 15  ISRsy 57 y 
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TABLE II (Continued) 


Rel. Val. SI Cri. 7 Ез 
47 v 
2 . 08 65 Cpgs i 
(No. 83 continued) Dê to .14 66 Cpes 8 Р 
Mean |6. 00 15 P К 
uie Gain E 37 to 44.62 15  ISRsy d ° 
-.15 to .18 = Ea 57 Y 
= Mean J 4.37 1 J 
Th Gain P 37 to 47.12 15  ISRsy 57 ү 
s ld 65 Ср з rd И 
-.07 to . 09 66 Cpgs 
* 84. Strayer-Engelhart Teacher Rating Р 
Scale, Short Form, С. Е. Williams 9 CTS 66 ۷ 
k .91 (S) -.425 to .855 3 Z 
and Son, Inc., Albany, New Yor 027 to .190 39 Ces 66 ۷ 
85. Student Data Booklet, School of Ed- 
ucation, Univer sity of Wisconsin, 
Personnel Research Office (mimeo- 54 / 
NG . 074 to . 246 81 ISRsy 
graphed) -.315 81 ISRsy 43 : 
. 049 81 ISRsy % ү 
-. 237 to . 243 81 PuR J 
. 169 81 PuR aT ү 
.167 81  PuR 45 ү 
-.365to.212 81 PGS 16 ү 
-.057 81 PGS 12 
* 86. Student-Teacher Social Distance 
Scale, adapted from Classroom So- 
cial Distance Scale. Horace Mann- 
Lincoln Institute of School Experi- 4l Vv 
mentation, Columbia University NG . 069 73 1585г J 
. 369 to . 750 73 PuR 4 
* 87. Supervisors’ and Evaluators’ Scale 
and Anecdotal Report of Visitation 
and Conference ; Western Dane 
County Curriculum Committee, / 
Madison, Wisconsin NG . 070, . 471 22 ISRte 18 
* 88. Teachers’ Summary on the Tasks of 
School Educational Attitudes, West- 
ern Dane County Curriculum Com- 
mittee, Madison, Wisconsin NG .278t0.512 22  ISRgr 118 y 
* 89. Teachers’ Summary on the Tasks of 
School Educational Practices, West- 
ern Dane County Curriculum Com- 
mittee, Madison, Wisconsin NG - 000 to . 709 22 ISRsy 50 ۷ 
. 207, . 852 22 ISRte 18 V 
.201 22 ISRte 118 / 
. 483 22  ISRsr 118 / 
* 90 Teacher Judgment Test, Department 
of Education, University of Wiscon- 
sin NG -.14 to .79 69  ISRsy 72 У 
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TABLE II (Continued) 
Rel. Val. SI Gri. N El. Sec. 
91. Teacher Placement Department 
Rating Sheet, Form TPD-S, Indus- 
trial Commission of Wisconsin, 
Madison, Wisconsin NG 529 12  ISRsy 16 ۷ 
-. 021 12 ISRsy 12 v 
92. Teacher Questionnaire, Wilbur 
Brookover, Indiana State Teachers 
College NG -.52 to . 89 11 ISRsy 65 ۷ 
Yule’s Q 57 to . 70 Ti ISRte 62 ۷ 
. 67, . 62 11 ISRte 65 v 
.54 11 ISRsy 62 " 
93. Teacher Self-E valuation Form, H. 
M. Anderson, Department of Educa- 
tion, University of Wisconsin NG .23 2 PeR 30 / 
. 33 2  ISRsdr 30 / 
.262 73 PuR 41 / 
E 73 ISRte 4l ү 
.079 73 Cisrsy 41 / 
94, Teacher -Student Social Distance 
Scale, adapted from Classroom So- 
cial Distance Scale, Horace Mann- 
Lincoln Institute of School of Exper- 
imentation, Columbia University NG -. 068 to . 166 "3 Cisrsy 41 ۷ 
‚441 73 ISRte 41 y 
95. Teacher-Teacher Social Distance 
Scale, adapted from Classroom So- 
cial Distance Scale, Horace Mann- 
Lincoln Institute of School of Exper- 
imentation, Columbia University NG -.088, .321 73 1565г 41 n 
-.045 73 Cisrsy 41 / 
.133 "3 Рок 41 n 
.032 to . 581 73 ISRte 41 ۷ 
96. Teachers College Psychological Ex- 
amination, State Teachers College, 
st. Cloud, Minnesota . 95 (M) 1.5 15 PGS 57 / 
Меап 1.12 to 18.18 15 ISRsy 57 ۷ 
Gain 1.0% 54 Cpgs 200 ў 
.05 65  Cpgs 47 ۷ 
30 to . 47 66 Cpgs 24 ў 
97, Teaching Situation al ig | Reo 
i Wiscons in (ml - 
dr NG -.06 to . 17 44 C 45 v 
grap 01 to .16 44 ISRsdr 36 / 
=. 02 to , 32 44 ISRsy 45 ү 
-.01 to .13 44  ISRp 45 / 
.08 to . 41 44 C 24 / 
-.10 to . 22 53 ISRsy 72 / 
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TABLE II (Continued) 


Rel. 


Val. SI Cri. N Е. Sec 
* 98. Technical Agricultural Information, 
adaptation of Mastery Tests in Ani- 
mal Husbandry, Interstate, Dan- 
ville, Dlinois NG 213018 4248 — 78 тан ке | 
j .157 to . 321 78  ISRp 60 у 
.214to.375 78  ISRas 60 И 
.233, .243 78  ISRsy 60 ч 
.156to.404 78 60 
* 99. Test of Teaching Problems, T. L. 
Torgerson, Department of Educa- 
tion, University of Wisconsin (mim- / 
eographed) -.11 to . 44 66 — Cogs 24 
100. Test on Alaska, C. D. Jayne, Uni- .84 (S) 
versity of Wisconsin . 79 (S) 4 x 
. 77 (S) -.19 3" PGS 95 
*101. Theory and Practice of Mental Hy- 
giene, T. L. Torgerson, Depart- 
ment of Education, University of Jj 
Wisconsin (mimeographed) NG -. 367, -.029 45 PGS 31 у 
.243, .350 45 С 31 | 
.2" to .54 66 — Cpgs 31 
102. Thurstone Te m perament Schedule, 
L. L. Thurstone, Grades 9-16 and 
Adults, 1949-50, Science Research " 
Associates, Chicago .61 (0.82 (5) -.17 (0.26 24 ISRp 64 J 
-48 0.77 (5) — -.04to .18 24  ISRp 61 / 
-46to.77(S) -.14 (0.20 24 ISRsy 62 / 
-. 26 to . 31 24  ISRsy 58 j 
-.14 to .12 24  ISRp 63 ү 
. 03 to . 24 24  ISRsdr 60 У 
-.14 to . 16 24  ISRsr 62 ү 
-.01 to .16 24 рен 56 / 
-.19 to ,21 24 рун 53 И 
-.29 to . 26 57 Cisr 35 
*103. Torgerson Diagnostic Rating Scale 
of Instructional Activities, T. L. 
Torgerson, Public School Publish- -86 to .89 (5) 
ing Co., Bloomington, Illinois .92 (S) 11.56 15 PGS 57 У 
Меап -18 to 51.68 15 ISRsy 9T У 
Gain -.509 0.800 39 CTS 66 У 5 
--124 0.3020 39 Срез 66 А 
7. 275 to .103 45 PGS 31 J 
-.139, .002 45 [9] 31 y 
--404 0.539 50 PGS 66 “J 
. 43 65 Cpgs 41 У 
-16 to . 34 66 Cpgs 24 
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Rel. Val. SI Cri. N El. Sec, 

*104. Wisconsin Adaptation ofthe M- Blank, 
original M-Blank Data for Individual 
Staff Members, 1940 Edition, Coop- 
erative Study of Secon dary School 

Standard NG .13 2 PuR 30 / 

.43 2 ISRp 30 V 

. 29 2 PeR 30 / 

.57 2  ISRsdr 30 ۷ 

.61 to . 77 46  ISRte 32 ۷ 

‚80 46 ISRp 32 ۷ 

. 880 49 Cisr 58 ۷ 

. 80 49 Cisr 54 / 

‚831 49 Cisr 45 / 

‚ 123 49 Cisr 32 / 

.835 49 Cisr 53 / 


*Mathews (54) represented the calculated percentages as the summary of results of item validation. 


JOURNAL OF EXPERIMENTAL EDUCATION 
(Volume 30, Number 1, September 1961) 


CHAPTER V 


THE USES AND ABUSES OF CORRELATIONAL AN 
IN THE EVALUATION AND PREDICTION 


D REGRESSION TECHNIQUES 
OF TEACHER EFFECTIVENESS 


ALLEN ABELL 


The ability to predict the value of one vari- 
able (here, teacher effectiveness) on the basis of 
one or more variables (predictors) depends on 
the relationship or covariance between the vari- 
ables in the underlying population. While the er- 
ror in prediction depends on the degree of covar- 
iance, the more important and often neglected 
aspect is the consideration of the actual but un- 
known degree of covariance in the population in- 
volved, 

If a truly random sample is taken from a well 
defined population, it is possible to establish, on 
the basis of probability, the sampling error of 
the predictive statistic thatisused. On the other 
hand, if the £roup studied is either a whole cur- 
rent population or a random sample from a whole 
current population, any predictive device can 
merely predict that which has taken place. 

It would seem reasonable for predictive pur- 
poses to define the population as that being con- 
Structed year after year in segments by the rel- 
atively stable social forces in operation through 
Some period oftime. Theextent of the population 
defined would be limited only by the purposes of 


the study and the degree of relationships that ac- 
tually exist in the population. It is possible that 
the most important traits of good teachers might 
range from common qualities of all teachers in 
to specific qualiti 


If thereisa non-situational nationwide agree- 
ment, which there 


is not likely to be, as to the 
qualities of a **good" 
the starting point for defi 


the defining of a popu- 
er One institution Such as a 
state university. 


: Each year a group of individ- 
uals is graduated from the in stitution, certified 


*Normal approximation without correction for Skewness Of r dist. S. E 


. in em- 
to teach at some subject-area level and Deed 

ployment within a limited geographic je group 
does not seem unrealistic to consider this E 


^s that iS 
as a segment of a po pu lation of teachers th 


; from rea 
composed of selected people who come ft tae 
sonably common cultural backgrounds, nye ae 
areas, and public schools, and who atten , 


б academic 
iversity. The selective factors of acad 


` rs uire- 
grades, school of education admission req uire- 
ments, and graduation and certification req 


e 
| Se ; to th 
ments would give additional commonness 


5. 

group with already similar cultural backgrow e- 
Hopefully, this commonness could be expande 
yond the doors of one institution. ervi 

If this population has measurable aper ge 
variables that are closely related to their ach nei 
ment as future teachers, either as equi a 
any subject field and/or geographic area, 
t 


" 
M as e Sp 
eachers in more Specific fields and/or more 


ез de 
cific localities, andthere are some statistical ne 
vices to handle 


adequately these variable not; 
problem of prediction should be solvable. 


Let us nex 
the distributio 
and the possi 
known 


we ol 
t consider the possible natn п 
n of variables in such a popul? un^ 
ble devices for discovering the 
relationships. It seems reasonable here 
Sume that teachers аге а selected group (and 


А i 9 

15 Some data to support this assumption pec al 
institutions) and that teaching requires parti mu 
characteristics of in 


E 
dividuals; it would Duy 
seem reasonable to assume that teaching e the 
15 а nearly normally distributed variable and 5^. 


р ар 
Possible pre-service covariables also wona thie 
proach normality in this selected population. 1 
seems acce 


ica 
Ptable, let us look at two hypothe on 
hat one might find in a “sample! 
ariate normal distribution by consi 
g ability and one possible covariate. " 
top of next page). Figure A and Figure Bi pig” 
trate how misleading a low correlation and а 


8 
> ple 
correlation, respectively, between two varia jn 
In a sample migh 


t be in light of the underly ле 
Population relationship. To further empha e* 
this point, let us look at Table [ of арргох оп 
Confidence intervals for a Pearson correla 


extremes t 
this multiy. 
ing teachin, 


(see 


2 


1 =r? 


Vn 
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FIGURE A 


Grade Point Average 
(if a covariate) 
t 


Principal’s M-Blank 


TABLE I 
r 95% Confidence Interval 
. 00 -.28 to +. 28 
. 20 -. 08 to 4.48 
. 30 4.04 to +. 56 


Coefficient for a sample of fifty cases if the sam- 
ple were arandom sample from the population 
tad ofatime sequence segment of the popu- 
ation. Now it is possible that a time sequence 
Sample could have either wider or narrower con- 
idence intervalslike those given above, hopefully 
ne latter if proper but still useful population 
limits can be established. 
Tn light of these and other inadequacies of the 
Correlation coefficient or related covariance 
measures in a time sequence sample (rather than 
random Samples), the question arises as to what 
Course of action is possible to ferret out the re- 
lationships Which are hopefully present. The an- 
SWer, of course, lies in the unk nown population 
Covariances and whether these exist in substan- 
tial magnitude from the broadest nationwide, 
Statewide, or citywide teacher evaluation down to 
the teacher graduates of specific institutions 
aching a specific subject at a specific level. If 
Опе is willing to agree that teaching ability is 
Predictable or in other words one is willing to a- 
Sree that the selective factors Of TE M oda 
relatively stable jn our society over ‘dation and 
time, then the process of cross vali я os e 
estructuring of predictive statisties wY best 

ential gains in information s€ €? sar 
rout A +a period of years 
€, whether one does itover à P pula- 

One institution or one takes а broader po 


t ie од e. fez Aé 
us logical p oris, but also Tn tight of what ns iet 
Wants as à product of its schools. First there is 
need of a realistic definition of performances thai 
achieve the desired goals, and second, we need 
accurate and unbiased means of measuring these 
performances. 
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FIGURE B 


| ©? 


1 2 з 4 5 
Principal's M- Blank 


Grade Point Average 
(not a covariate) 


tion definition ana attempts to discover underly- 
ing relationships on a shorter period of time by 
accepting uniformity in judgment of teaching 
quality over a large geographic area. 

The main point here is that a correlation co- 
efficient or related measures of covariance are 
extremely useful, but inthe context of prediction 
of teacher ability they must beused with extreme 
care or they can be very misleading. The abil- 
ities and achievements studied in the investiga- 
tions here summarized are of a selected group 
and consequently limited in variance which con- 
sequently may reduce the covariance inthe un- 
derlying population. If relationships do exist in 
the underlying populations of which these studies 
are a segment and the relationships are supple- 
mentary, then these carefully conducted studies 
should provide us with a start in the search for 
the population relationships that when found will 


in a composite form provide us with adequate 
predictions. 


Related Considerations 


The remaining portion of this chapter will deal 
with a new look at a few of the studies here sum- 
marized with an eye to possible improvements in 
data handling. But before this, it is necessary 
to clarify some considerations about tests which 
are employed. 

The greatest problem in predictingteacher ef. 
fectiveness lies in the definition and evaluation of 
teacher effectiveness. In our society We not ony 


have to дш, dust oi Fea eat оне 
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In the studies here reviewed, both pupil gain 
as measured by standardized tests and supervi- 
sory ratings orientated around the Wisconsin 
Adaptation of the Principals M-Blank are used. 
These criteria are considered because both types 
of evaluations have been used in the past and not 
because they are accepted as being adequate in 
these studies. 

The problem of finding pre-service covari- 
ates that exist in the population would seem to be 
a lesser problem once a realistic and adequate 
definition of the qualities expected in good teach- 
ers have been determined. Objective and sub- 
jective devices that measureor purport to meas- 
ure qualities and achievements of people canbe 
tried and improved or discarded as they have been 
in the past. Hand in hand with this process will 
go various statisticaltreatments of the covariates 
or apparent covariates. Perhaps the additive as- 
sumptions which are made in connection with 
most predictive statistics may have to be recon- 
sidered, and possibly other approaches might be 
employed. One might, for exam ple, define the 
lack of teaching ability as the absence of one 
quality or being very low in a particular quality 
no matter how highthe person measures on other 
qualities related to success. Perhaps a non- 
additive statistic will evolve that will more ade- 
quately represent the population relationships. 
This possibility will be explored ina later chapter. 


A Review of Selected Studies 
— Ct Detected Studies 


The first approach made by the writer was 
to examine the correlations from study to study 
to get an idea as to the relationships that might 
exist in an undefined but possible time sequence 
population. It was found that there was so much 
variation in the types of pre-service and co-ser- 
vice measures used as well as some variation in 
the evaluation criteria that this approach could 
not be pursued extensively. 

Two studies were found, however, that were 
Sufficiently parallel towarranta contrast of cor- 
relation coefficients for consistency and range of 
magnitude. These were studies by Rostker (66) 
and Rolfe (65) which wer € carefully done in the 
late thirties and inwhicht 


he students were under 
the influence of only one teacher, 


Rostker's study involved Seventh- and eighth- 
grade citizenship classes in small non-depart- 
mentalized graded Schools. Rolfe's Study in- 
volved seventh- and eighth- grade citizenshi p 
classes of one- and two-room rural Schools. 
While there is a difference in the type of school, 


*Robert J. Wherry, 


“Multiple Bi-Serial and Multipli i i- i i 
um Aeon d ple Point Bi-Serial Correlation, 


Charles C. Peters and Walter R. у 


2n Voorhis, Statist 
(New York: McGraw-Hill Book Co., 1940), pp. 384-97 


both studies covered comparable geographic 
areas, both groups of teachers had similar edu- 
cational backgrounds and teaching experiences, 
and both groups hadsimilarly prescribed units of 
instruction in citizenship that were evaluated for 
residual pupilgain. This gain involved the sta- 
tistical control of uncontrolled variables such as 
I.Q., reading, socio-economic strata, and initial 
test scores. The standardized evaluation tests 
dealt with areas of health, community planning. 
abilities to organize research materials, civic 
beliefs, applying generalizations, civic attitudes, 
civic information, and civic action. The corre- 
lations with residual gain as the criterion are 
shown in Table II. 

The lack of close agreement in correlations 
could be due to many different reasons, but rather 
than speculate as to this it was decided to take 
the variables with the closest agreement and 
larger magnitudes and contrast the extreme cases. 
While this may at first appear to be an overfitting 
of data, it was adopted under the hypothesis that 
the extreme cases would magnify the differences 
between good and poor teachers and help compen- 
sate for the errors of measuring devices. In ad- 
dition to this it would seem more valuable from 
a practical point of view to be able to predict a 
likely high degree of success or failure rather 
than likely average success. 

Three devices wereusedas a basis for com- 
parison. Multiple regression was usedas a stand- 
ard for comparison because of its wide use in pre- 
diction. Fisher's Discriminant Function and а 
combination of Wherry's Multiple-Bi-Serial and 
wide-spread Biserial* were used onthe extremes. 

In all three devices the best predicted score 
is based on a linear combination of weighted pre- 
dictors which assumes the quality of additivity. . - 
Z = W1Z1 + W2Z2 + W3Z3... The 2 is an indi- 
vidual's predicted score, the Zi are the individ- 
ual's covariable or predictor scores and the Wi 
are the weights arrived at by one of the proces- 
ses below. | 

Judgment of how well the particular statisti- 
cal function fits the apparent ‘‘sample’’ relation- 
Ships (not the population relationships) is made 
on the basis of how close the individual’s predict- 
ed scores approximate the observed scores. 

The Multiple Regression employed is based 
on the hyperplane of best fit for the observed data, 
or in a two-dimensional system the line that 
passes through the scatter diagram of two corre- 
lated variables in such a manner that the sum 9 
the squared deviations between the predicted points 
(on regression line) and the observed points is а 


ical Procedures and Their Mathematical Bases, 


ABELL 
TABLE II 
Co-service Teacher Variables Rostker Rolfe 
Intelligence (A. C.) ‚51 -.10 
Intelligence (T. C.) .40 .05 
Social Adjustment (W.) .13 .06 
Social Attitude (H.) #82 . 38 
Aims of Education (L and S) .30 -.06 
Leadership (M. ) .20 m dri 
Bernreuter Dominance (Bd.) .25 .04 
i 45 .22 
Teacher Knowledge of Mental Hygiene z 
= 15 
Stanford Aptitude (A. R-) .04 
-. 01 
Civic and Government Test (A. C.) .36 
.22 
Professional Attitude (Y) .45 
TABLE Ш 
T E 
Rostker | ۴ AA =+ 27Z1+ ` 3372 + .01Z3 + 4524 + 0Z5 
Regression 
gi NC. . 4121 + ‚1372 + .02Z3+ .1174+ .4475 
ҳу. 5. Віѕегіа 
„9774 - .232 
— | d gi + 1.8022 - 5823+ «а ° 
piscrim. 
6 ‚282 
Rolfe Zc = ` ‚1771 + ‚0272 + ‚3873 + .2624 + 5 
ession 
= Ze =" .2971 + ‚0422 + 1.0723 + .5974 + 1. 2825 
W.S. piserial c 
Function Zc =+ .4221 + · 1479 + «7923+ .58Z4 + 1.9825 
Discrim. unc 
SAN 


51 


52 


minimum or >| Z(obser ved) - Z(predicted)]? is 
à minimum. In matrix notation the Beta Weights 
which are the coefficients for the ‘‘plane” of best 
fit are derivedby B = R-Ir, where В-1 is the in- 
verse of the intercorrelation matrix of co-variates 
and r is a columnof correlations between the cri- 
terion and the co-variates, 

The discriminant function arrives at weights 
for the co-variates by maximizing the ratio be- 
tween the mean differences between the two groups 
and the square root oi their pooled within vari- 

; the purpose of which is to weight the pre- 


the column of mean di 
of predictors, 


In the case o 


the coordinates of a point in three ame e 
points for allthe individuals tendto fo 
me configuration, 
€ object in multiple regression i i 
n is to 
the plane that passes through this configuration P. 
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FIGURE C-la 
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r that the sum of the squared devia- 


: -edicte 
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Scores (on the plane)isa minimum. Figure 


Shows one of 
and summed. 


red 
the many distances to be uon 
20 is one observed score ( 


2 icted 
above the prediction plane) and 2 is the predict 


Score on the plane, 


fea 
for a person with the part! 


ular G. P. A. and I. Q. score that corresponds 


the Zo observed Score, 
Perfect, that is, 


If the relationship ы 
if you could predict M- Bl? 


s he 
rating perfectly from G. P. A. and L Q. thent 


Configuration 
Oval shape an 


à ]a! 
9f C-1a would collapse into aie 
d all the observed scores wou 


ture 
on the prediction plane. The degree of depart" 


from this idea 
adequacy of t 


tional Tepresentati 


lationship. 


ical criterion 
between the o 
In the case of 
basic equatio 


In the cases al 
Multiple wide-spread biserial, the mathem^ nt 


rudem Û 
lserves as the basis for pi о" 
he regression techniques vut re- 
Оп of the observed sample 


FIGURE C-1b 


`. Prediction Surface 
(plane) 


5 an 
of the discriminant function t^ 


is not the closeness of agree ç 
bserved and the predicted score ^, 
multiple regression, The 5 Q: 
n is used [ Z(composite) = W1(-- 


k 


+ W2 (Grade Point Average)] in the discriminant 
function, but in this case the individual compos- 
ite scores are derived by weighting the predictors 
so that the distributions of composite scores for 
the two groups, the very successful and the un- 
successful teachers, will be distinct as possible. 
The means of the two groups of composite scores 
Should be as far apart as possible and yet main- 
tain a small overlap of scores (Figure С-2). The 
purpose is to distinguish as accurately as роѕ51- 
ble between likely good or poor teachers on the 
basis of the predictors. 


FIGURE C-2 


Frequency 


2, 
Composite Scores 


The multiple-wide-spread-biserial E bapa 
lar to the discriminant function sac elation 
Maximizing the wide-spread biserial pone 
Of the composite scores sity teacher O ‘hts that 
Scores, The process determines Lacan 
give the high and low £r OUP P chui distri- 
large difference without making the кн width 
bution of com posite scores of exc 


(Figure C-3). 
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“predicted” in the sense that the Statistical de- 
vice employed produces them as an approximation 
to the observed scores and not as a true predic- 
tion. They are calculated for the purpose of eval- 
uation of the predictive function. The true predic- 
tion comes when you use the prediction equations 
to estimate the future scores of a parallel popula- 
tion on the basis of the predictors. 

In the Rostker-Rolfe comparison, the follow- 
ing predictors were used because of their fair de- 
gree of consistency: Z intelligence (T.C.), Z2 
Bernreuter Dominance (Bd), Z3 Social Attitude, 
Z4 Knowledge of Mental Hygiene, and Z5 Profes- 
sional Attitude. The high-low groups were es- 
tablished at Z scores onthe criterion of +. 80 and 
-.86 respectively. In Rostker's study this kept 
5 high and 6 low out of a total sample of 24, and 
in Rolfe's study 11 high and 11 low out of 57 were 
kept. Theregression weights are scaled auto- 
matically by their definition but the discriminant 
function and W. S. biserial were res caled with 
a constant multiplier to make them agree **on the 
average’ with group criterion averages for com- 
parison purposes. The prediction equations are 
shown in Table III. 

The processes involved in selecting the 
weights takes into account the inter-relationships 
between variables that are not readily seen in 
glancing at a correlation matrix, but, judging by 
the lack of agreement between the weights in two 
studies it would seem that either there was some 
difference in the execution of the two studies or 
the level of covariances ofthe criteria and covar- 
iables here included are low in the underlyi ng 
population t o which these two groups of teachers 
might conceivably belong. 

Looking at Table IV, one sees how the three 
devices fare as to proper group placement of the 
individuals in the specific studies. 

Although there is the danger of overfitting of 
data and little evidence of underlying population 
relationships, it appears that the investigation of 
extreme cases would be worthy of future consid- 
eration. 

Both the discriminant function and the M. W. 
S. biserial come closer to proper group place- 
ment of the extreme cases than the regression 
technique. 

Another interesting observation inthe rescal- 
ing of weights is that in both studies the high and 
low groups would have required a different con- 
stant to achieve optimum agreement with the cri- 
terion group averages when the predictor group 
averages меге used inthe rescaling ofthe weights, 
This would suggest the possibility of different co- 
variates for success and failure and the possibil- 
ity of being ableto predict likely success or fail- 
ure but not simultaneously with the same variables. 
Although these are based on very few cases, the 
contrasts are very suggestive and would seem 
worthy of future investigations. ' 
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TABLE IV 


Rostker 


Regression 


Proportion Outside of 


Proper Group 


Mean Deviationfrom 
Proper Group 


Rostker 


Multiple Correlation 


olfe Rostker Rolfe 
= 


„17 .26 .56 ‚16 .90 
W. S. Biserial . 36 18 ES .T8 .93 
Discrim. Function . 32 .14 39 
TABLE V 
Rostker Rolfe 
Low High Low High 
Intelligence (T. C.) 61 -. 37 07 17 
Bernreuter (Bd. ) -. 87 . 69 03 01 
Social Attitudes (H. ) OT 44 15 21 
Knowledge of Mental Hygiene . 70 -. 30 64 22 
Professional Attitude (Y) 19 87 34 2 
А " 2: sA 
Number 6 5 


11 11 


—— M À— 
—— 
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TABLE VI 


Freshmen-Sophomore G. P. A. 


Education G. P. A. 


Practice Teaching Grade 


In 


Ww 


tion Outside 


propor 
of Proper Group 
Regression ‚16 ‚65 
w. S. Biserial .48 
piscrim. Function ‚59 
Number 17 17 


itiative 


ork Habits 


ج ن UDIT‏ 


TABLE VII 


.42 


Mean Deviati 


on from 


proper Group (Z Score) 


.56 


.90 
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The Lins-Von Haden Studies 


| As was pointed out earlier, there was con 
"yen lack of parallelism between the studies 
iros be extensive contrast of correlations was 
Ex rea le, and thus a comparison of predictive 
ре ша evolved. It was decided to carry this 
bi dad e ison to the supervisory rating criteria 
sto vas partofthe Lins (49) and Von Haden (82) 
tach s. Both dealt with the same group of 58 
ЖАПАР, and together included a large number of 
fens re that are possibly co-related to the cri- 
vals à. the Wisconsin Adaptation of the Princi- 
age -Blank; the Lins study used mostly objec- 
il ata while the Von Haden study was primar- 
y subjective personal data. 
"Pers group of teachers in the Lins and Von 
Who nstudies consisted of 58 women teachers 
аан graduated from the University of Wis- 
1943.4 in 1943. They were evaluated during the 
DI. 4 school year while in their first year of 
eni teachers. There were teachers of the 
ani owing subjects: Art-5, English-16, History 
Ki Social Studies-5, Home Econom ics-23, 
usic-4, miscellaneous-5. 
Von The variables considered here fro 
thei Haden studies were chosen on ] 
E. maintainance of afair degree of correlation 
Bri M-Blank ratings in a follow-up study by 
be БЕ (14). The zero order correlations with 
Ex cr iterion for the Lins-Von Haden studies are 
own in Table VI. 
PE n three statistical devices mentioned 
and ier were used to derive prediction equations 
in predicted scores. Table VIIgives the result- 
Ë contrast between the predicted scores and the 


Observed scores. 

W. s Again it was noted t 

Чоп. Biserial weights and 1 

fitti weights would have been more optimal for 

sss the data if it could have been done by groups 
ead of on the average for both groups. 

able A study of the other possible predictor vari- 

dict S for the individuals that appeared least pre- 

ed pe with the W. S. Biserial predictor yield- 
he results shown in Table ҮШ. Someofthese 


addit; i 
ditional variables show promise 
very small so it 


er 4 
Can Of cases contrasted here 1$ 

ion for possible sup- 
0 int investigate 
© interesting to note that all those Who were pre- 
‘cted unu E Biserial equa- 
i Sually high by the W. 9 15 
quee follow-up study by 


mthe Lins- 
the basis of 


hat the scaling of the M. 
the discriminant func- 
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Briggs ten years later. The di ies i 

predictions might also be due ane gone of 
too broad a classification of teacher skills a 
so many specific teaching areas are A 
Again, it remains to be seen when one be = 
uncover the relationships in the broadest is " ° 
tion category he wishes to investigate. кк 


Conclusions 


It should be re-emphasized that the statisti- 
cal treatment of the data in these two groups of 
studies does not imply that the relationships found 
in these studies are considered as being relation- 
ships of some population as earlier defined. The 
investigation of the extremes was done merely to 
explore the possibility of this approach as an im- 
proved means of gaining insight into population 
relationships. Alsofive predictor variables were 
used instead of more— merely for computational 
purposes. 

The Wide-Spread Biserial method and the 
Discriminant Function method are fairly compar- 
able in theory but the W. S. Biser ial method is 
easier com putation-wise when correlation and 
standard deviation are available. 

It appears that much attention Should be given 
to the establishment of commonly accepted bases 
ging teacher qualities in the population un- 
cern and that devices for measuring these 
qualities should be developedor improved. There 
is considerable evidence in these studies that the 
evaluation measures used lacked extensive reli- 
ability and validity. 
if possible, these improvements, the 


Given, i 
treatment of data gathered might well consider 


the following points: 
of the extreme cases for adequate con- 


for jud, 
der con 


1. Study 


trasts. 
Consideration of the predictability of success 


or failure, separately. 
Won-additive predictive devices that would ac- 
count for failure when one quality is low and 
the rest high, if this proves to be the case. 

4. Canonical correlationthat makes use of a com- 
site of teacher evaluation traits correlated 


2. 


with predictors. 
A careful follow-up study of ‘‘unusual’’ spe- 


cific cases that seem unpredictable. 
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CHAPTER VI 


FACTOR ANALYSES OF THE TEACHING COMPLEX 


JOHN SCHMID * 


Teaching is a complex activity carried on in 
a complex environment--the school. It is di- 


It is difficult to 
because the elemen 


by the use of different names or wo 
for the same referent-element, 
teacher must have sufficient intel 
form his job effectively, But th 
might also be called brightness, aptitude, ability, 
Proficiency, etc, Although the referent-charac- 
teristic may be the Same, the use of different 
verbal symbols for this charac 
Semantic and meas 
understanding of its nature, 

The elements of the teach ing 


For example, a 
ligence to per- 
is characteristic 


oom induccd by 
the teacher, and behaviora] cha i 
dents attributable О the teache 


able that this characteristic is part of the com- 
plex. But does a teacher who acquires insight in- 
to and intimate knowledge about his Student’s 


*All footnotes will be found at end of this chapter. 


academic abilities, interests, incentives, m 
backgrounds, and personalities do a better pes 
teaching because of this knowledge or is ue 
merely a correlative Characteristic of the g< "n 
teacher in the sense that a good teacher wi 
Search out such knowledge of his students. на 
Over the past several decades, many i =a 
have been carried out on teachers and re са 
aspects of the teaching complex. Personal с um 
acteristics of teachers have been assessed bee 
objective psychometric instruments as we Ша 
with ratings by Superintendents, pr inc ipa a 
peer-teachers, and Students. The ا‎ н 
of the classroom has been examined with view 24 
assessing the teacher while working on the j of 
Also, teachers have been assessed in ter ms rs 
the changes in behavior of their students. In cadi 
eral, this latter method of evaluating teacher pe 
formance has b XE 
the students’ educational development at two dif 
ferent times 
of the teache 


Procedure of This Study 
— nis Study 


Because o; 


f the multiplicity of verbal ap- 
pellations for 


elements in the ss n 
ness complex, it is believed that the domain o 
the elements and their correlates shouldbe map- 
ans of correlationanalysis to deter- 
ofusion of elements is realor 18 
mere verbal redundancy. With factor analysis 
techniques we have a Statistical toolfor deter- 
mining if the apparently many diverse e le ments 
of the teaching complex are really distinct or if 

they are only semantic variations of fewer read- 
ily identifiable components. 


; Allof the studies ex- 


re-factored employing the same 
method and criteria. 


m —_— 
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| In the historical development of factor anal- 
ysis, many factor analytic techniques have been 
developed. The application of these many te ch- 
niques to the same data need not give the same 
results because different assumptions are im- 
plicit in each technique. During this develop- 
mental period, the investigator frequently 
was limited to less mathematically elegant factor 
analytic techniques because of the unavailability 
of the necessary high-speed computors which we 
have today. With the development of modern e- 
lectronic computors and because we have today a 
more advanced statistical theory, we are now in 
position to re-examine some data of past studies 
to determine if a clearer picture evolves of the 
nature of teaching-effectiveness complex. With 
these points in mind, data from several studies 
has been factor analyzed by the normal var imax 
Procedure developed by Kaiser (1958). 

The normal varimax solution is signifi- 
Cant because it is invariant under changes in the 
Composition of the matrix of the variables being 
analyzed. Prior factor techniques had not ob- 
tained this property. 

What does this property of invariance 
It means that if a set of variables are eliminated 
from a correlation matrix, the factor loadings for 
the remaining variables would be the same asif 
the set of variables had not been eliminated. 
Stated in another way, it means: if we are given 
an infinite domain of variables and we want to 
infer the internal structure of this domain on the 
basis of a sample of variables from the domain; 
then, to the extent that the factor is invariant un- 
der various samples of the variables, there is 
evidence that inferences about the domain factors 
are correct. Kaiser? offers a powerful demon- 
Stration of the invariancy of the normal varimax 
Solution applied to sets of variables of Holzingey, 
and Harman twenty-four variable empirical data. 
In addition to possessing this highly desirable 
Property, the normal varimax solution apparent- 
ly tends to approximate orthogonal simple struc- 
ture which facilitates interpretation of the factors. 

The normal varimax solution is not obtained 


directly from a correlation matrix. Itis oe 
Y rotatin, s of factor solutions to the 
pr e in performing the 


Vàrimax form. Consequently, 
it was necessary tode- 


mean? 


Principal axis methods. Before th 
troi! 
ed most prevalently because of its greater sim- 
ey in computation. However, it has been long 
m: Cognized that the principal axis methodology is 
s athematically superior. In the #ollowing ana y- 
thes Principal axes factors were obtaine d an 
е rotated to the varimax form. 
Another problem that has troubled the factor 


d method was 


ee Ar up солнце аа. 
tors whose intent fo oak HM IT 

ots were greater than unity 
were extracted from the correlation matrices. 
Furthermore, unities were used in the diagonal 
elements. This criterion for the number of com- 
mon factors was accepted on the basis of two 
considerations. Guttman? demonstrated that the 
number of common factors ina domain must be 
at least as large as the number of latent roots 
greater than unity of the correlation matrix with 
the ones in the diagonal. Secondly, Kaiser has 
found that the generalized Kuder-Richardson re- 
liability of a principal component willbe positive 
when the associated latent root is greater than 
one, Guttman’s theorem suggests that if latent 
roots greater than unity are used as a criterion, 
too few common factors may be extracted f r om 
the correlation matrix. However, this weakness 
is offset by Kaiser's findings regarding the gen- 
eralized Kuder-Richardson reliability of a prin- 
cipalcomponent. Although, using this latent root 
criterion, it is possible that toofew common fac- 
tors may be extracted from а correlation matrix. 
Kaiser points out that an ana lytically rotated 
structure in factor analysis is less sensitive to 
too few factors than to too many factors. 

With allof these considerations in mind, 
factor analyses were made of reported teacher 
education studies in which were found commonly 
accepted criteria of teaching efficiency: change 
in pupil behavior and ratings of teaching effec- 
tiveness. It is not feasible to present the entire 
factor solution for studies yielding many factors. 
For these cases, it was decided to report in tab- 
ular form only factors which had significant 
(larger than 0. 30) loadings for the criterion var- 
ables. Furthermore, for these factors only var- 
iables having loadings larger than 0. 30 меге con- 
sidered as practically significant. The first study 
orts factors for other than the criterion var- 
iables to show the general nature of the teacher 
variable domain. It is suggested that the reader 
refer to the original articles for information 
about variables involved in the studies but which 
are not included in this exposition because of 
their factorial inconsequence. The code numbers 
used by the authors of the original articles are 
used here to enable the reader to correlate thea- 
nalyses with the data of the articles. 


rep 


Factor Analysis of Rostker's Data (66) 


Rostker's central problem was the examina- 
tion of relationships between se lected teacher 
measures and learnings acquired by their pupils. 
To overcome the criticism that pupil changes are 
the result of efforts of a number of teachers, he 
used non-departmentalized Schools in order that 


any found changes ina pupil could be attributed to 


a single teacher. 
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Data were obtained for 24 teachers and 375 
pupils from rural and village schools, grades7 
and 8. The teachers were asked to direct their 
instruction toward two unit topics: “Safeguarding 
Public Health’’ and "Community Planning. ’’ Spe- 
cific course objectives were set upand a time 
table was followed. Thepupils were pre- and 
post-tested for informational gainat the beginning 
and end of each three-week unit. The two tests 
used were: Unit I - Health; Unit II - Community 
Planning. Furthermore, the pupils were tested 
at the beginning of the school year and at the end 
of the school year with two batteries: the Wright- 
Stone battery which measured long-term non- 
informational gain and the Hill batter y which 
measured long-term informational gain. 

Twenty-eight measures were obtained for 
each teacher. The teachers’ knowledge of subject 
matter was obtained by their taking the two unit 
tests and a test from the Wrightstone batte ry, 
Abilities to Organize Research Materials, at the 
beginning of the year. Other teacher measures 
obtained were: intelligence, personali ty, at- 
titudes, and ratings. 

Intercorrelations of 35 variables were fur- 
nished by Rostker in his Table XXVII. Twenty- 
Seven of these variables were teacher measures 


and the other eight were measures of pupil change 
(pupil gain). 


The Criterion Factors 
—  "Titerion Factors 


the next page). In general, descriptive names of 
the nature of the i 


ever, the actual 
Known tests. 


Ces in 
L.G... reading ability, socio-economic Ыы en 
pre-test scores of the pupils, ; 
Factors I and H unquestionab]: 
in the pupils’ intellective behavior" Apu 
distinction between these two factors is far from 
clear, it seems that a non-informationa] type of 
pupil gain prevails in Factor I. Assuming this to 
be а non- informational change factor, letus con- 
sider some of the variables. It Seems that the 
intelligence of the teacher as defineg by T-2 
is the highest single variable conditioning teach- 
ing ability. Social attitudes (T-3), attitudes 


toward teaching (T-4), knowledge of subject mat- 
ter (T-7), ability to organize research materials 
(T-1), and the ability to recognize, diagnose, and 
correct pupil maladjustment (T-5) also bear rer 
lationship to this factor. The negative loading for 
attitudes toward teaching, however, is puzzling. 
On the other hand, ratings of the teacher and ш 
teacher's personality as measured by such wel 
known instruments as the Bernreuter Personality 
Inventory and the Washburne Social Adjustm e nt 
Inventory seem to have little or no relationship 
to this factor. Factor I contains those variables 
which Rostker found by multiple regressionto be 
the significant predictors of the criterion. 

The existence of Factor II, in addition to 
Factor I, indicates the non-unitary nature of pu 
pil learnings. The highest loadings on this factor 
are for variables all of which represent pupil gain 
in information. Itis the sharpness ofthis factor 
which helps suggest that Factor I is of a non-in- 
formational character and that the pupil change 
variables involving informational elements in 
Factor ] are present because they also involve 
non-informational elements. It is of interest to 
note that for this more clearly defined Factor II, 
the attitudinal characteristics of the teacher do 
not appear, but that the teacher’s sociability (T- 
20) occurs with a moderate loading. í 

Apparently, there are at least two kinds 0 
intellective change occurring among pupils. One 
Seems to be of a non-informational change, pia 
other seems to be informational, It seems tha 
more of the teacher's characteristics (knowledge 
of subject matter, attitudes, insight in pupils 
problems) affect the non-informational acquis!” 
tions of the pupils than their informational gains: 
It would be interesting to examine the impact 0 
the teacher upon the personalities of children. 

T-10, T-14, and T-16 were ratings made bY 
Rostker; the other ratings were made by the 
teachers’ supervisors. Clearly Factor HI is Pa 
rating factor. Apparently, the attempt to rate dif 
ferent aspects of the teaching activity was n 
Successful. The ‘‘halo’’ effect resulted in pretty 
much of an undifferentiated global rati ng of the 
teacher and her activities. Furthermore, none 
of the other variables in the study, with the ех” 
Ception of the teacher's intelligence and he? 
knowledge of good educational practices, had load- 
ings in excess of 0. 30 on this factor. As a рге” 
dictable criterion of teaching effectiveness, rat- 
ings of the teacher were of little value. 


The Remaining Factors 


Factors IV through X were the remaining 
components of the 35 variable domain. On only 
one of these seven factors were any of the crite 
ion variables found. These seven factors герге” 
Sent structuring of the domain of variables und e! 
Consideration, but with the exception of Facto" 
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TABLE I 


Code Variable 


Loadings 
I H ш 


Pupil gain (C-1 adjusted) 
Pupil gain (C-2 adjusted) 
Pupil gain (C-3 adjusted) 
Pupil gain (C-4 adjusted) 


Social Attitudes Test 


1 


Rating of Teaching Skill 
Rating of Teaching Skill 


$. д. NY. d 
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Pupil gain, informational 

Pupil gain, non-informational 
Pupil gain, informational 

Pupil gain, total (C-1, C-2, C-3) 


Ability to Organize Research Materials 
ACE Psychological Examination .58 


Attitudes Toward Teaching 
Test: Recognition of Pupil Problems .31 
Teachers College Psychological Examination .91 
Community Planning Test (Unit II) 
Rating of Teacher's Classroom Activities .16 
Rating of Teacher's Personality š 


Bernreuter Fs, Sociability 

Knowledge of Good Educational Practices 
Rating of Teacher's Personality 

Rating of Teacher's Classroom Activities 


.26 .12 

14 .41 

42 .04 .04 
10 .82 
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nship to the 


VIII they apparently bear no relatio 
A brief dis - 


Criteria of teaching effectiveness. 


Cussion of each factor follows: 
Factor IV, designated as Social Adjustment, 
Was characterized by the Washburne Social Ad- 
justment Inventory, 0.86; the Bernreuter Fs,Fc, 
and Bn scales with loadings 0. 65, 0. 64 and 0. 60; 
and the scale of Teaching VS. Administrative A- 
bility, 0,53, This writer believes that the failure 
of the two Flanagan scales of the Bernreuter in- 
Strument to separate on different factors is a re- 
Sult of correlated error. Subtests of a battery 
frequently fail to give factor diagnosticity. This 
Correlated error may be called response set, test 
bias, ete. Apparently, 2 diagnostic instrument 
Contained in a single booklet tends to produce cor- 
related error, thus destroying the diagnosticity 
of the instrument. 
The Teaching vs. Administr ative Ability 
Test (T-23) is a E basal e of the Stanford Edu- 
Cational Aptitude Test. This test furnishes three 
ipsative scales for measuring teaching vs. 
administrative abilities, teachings VS- research 
abilities, and administrative vs. research abil- 
ities, 
á Factor V, like Factor IV, re 
Onality complex; the four Bernreu 


presents a per- 
ter scales have 


loadings as follows: Bd, 0. 85; Bs, 0. 77; Bn, 0. 66; 
and Fc, 0.45. The Teachers College Examination 
has a loading of -0.56. This factor seems to be 
a hodge-podge of personality characteristics 
probably produced by correlated error. 

Factor VI, designated as Non-Research Pro- 
clivity, is defined by the variables: Test of 
Teaching vs. Research Ability, 0.9%; Test of Ad- 
ministrative vs. Research Ability, 0. 94; Commu- 
nity Planning Test (Unit II) 0. 44; and a test of the 
teachers understanding of pupils problems T - 5, 
0.36. This near doublet is best defined by two 
ipsative subscales of Stanford Educational Apti- 
tude Test. The ipsative nature of these subscales 
suggests that teachers have less proclivity for re- 
search activity than either teaching or adminis - 
trative functions. 

Factor VII is best defined by a test of social 
open-mindedness, T-12, 0.83. Other moderate 
definers are T-9, knowledge ofcivics and govern- 
ment, 0.65; T-5, knowledge of pupils’ problems 
0. 58; T-3, social attitudes, 0. 57; and T-1, abil- 
ity to organize research material. 

T-12 is a test consisting of 475 true-false i- 
tems of the teachers' knowledge inseven areas of 
human experience corresponding to the cardinal 
objectives of education. According to the manual, 
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dogmatic and superstitious persons receive low 
Scores while persons possessing a scientific out- 
look and an open mind receive high scores. Thus 
it Seems quite consistent that T-1, a test of re- 
Search ‘‘know-how’ has an appreciable load i ng 
on this factor. 

Factor VIII is defined by T-4, attitudes toward 
teaching, 0.76 and T-22, knowledge of good edu- 
cational practices, 0.69. C-7 and C-3, both pu- 
pil gain variables have loadings of -0.40 and 
-0.33. This is the only factor other than the cri- 
teria factors I and II on whichcriterion variables 
are found to have a loading in excess of 0. 30. 

FactorIX, designated Classroom L eader- 
Ship, seems to describe that aspect of the teach- 
ing domain in which the teacher is a director of 
the learning process. This factoris made up of: 
T-17, test of classroom leadership, 0.77: 1-28, 
administrative vs. teaching ability, 0. 61; and 
T-9, knowledge of civics and government, 0. 45. 

Factor X is a specific factor defined by var- 


iable T-8, Health Test (UnitI) The loading for 
this variable is 0. 94, 


Summary 
Summary 


plex of this stud 
ten di i 


Factors I, H, and 
because they are ident 
to define “teaching eff 
pil behavior and r 
Change in 
kinds: non 


Ш are of special interest 
ified by criteria often used 
ectiveness’’: change in pu- 
ating of teaching ability. 
pupil behavior was found to be of two 
-informational and informational. The 


knowledge 


mational gains, 
The other criterion 


I research functions to 
teaching and administrative fu nections, open- 


mindedness, attitudes toward teaching, ang a 
trait characterized as class leadership. 


Factor Analysis of Rolfe's Data (65) 


Introduction 


Like Rostker, Rolfe examined the relationship 
of change in pupil behavior to various posse dit 
istics of the teacher, Rolfe studied 47 teachers 
from one and two-room rural schools in isemi 
sin. The pupil-change criterion was based on 4 
i oun pupil behavior was measured ei 
forming a composite of the Wrightstone, Hill, de 
Unit batteries mentioned in the Rostker piu Ar 
From this composite, variation inpupil abili T 
as measured by I.Q., mental age, and reading 
bility was partialled out. Е 

A second criterion of teaching efficiency . 
ists in this study in the form of ratings oÍ N 
teacher and her teaching activities. Other yar- 
iables included by Rolfe in his analysis were ae 
telligence; knowledge of subject matter;pers msi 
ality; aptitudes; attitudes; socio-economic stat 5 
and some characteristics of the school ere 
Many of the tests and indexes used by Rostk 
were also used by Rolfe. j= 

These measures furnished a 31 x 31 corre d 
ation matrix (Rolfe, Table XX). Of the eleta 
varimax factors found, two were defined byt 
criteria: pupil gain and rating of the teacher. ° 
in the Rostker analysis, the variables whos 


loadings exceed 0. 30 are reported for these two 
criterion factors, 


Factor I is a 
gain variable of t| 
Rostker's study i 
justed composite 
change. 
this facto 
Rostker 


pupil-gain factor. The p upile 
his study is similar to C-8 dè 
n that essentially it is an e 
of the three measures of PUP Р 
The most distinctive difference Lact 
r and its correspondent, Factorl, of ng 
Study is in its failure to pick up a load! 
for the teacher's intelligence. Although the AC 
Psychological Examination was included in thi ; 
matrix, its loading on this factor was only -0. а^ 
It may be of interest to note that the teacher’S 
bility to recognize pupils’ problems was foun d- 
have a low moderate loading on these correspo” 
ing factors (see Table II shown at thetop of t 
next page), at 
Factor II of this study is defined лы А 
exclusively, as in Factor III of the Rostker ana T 
SiS by ratings of the teacher and her activi F 
S in the Rostker analysis, low moderate loadin, 
are found for pupil gain and social attitudes. OF e 
again, the failure of the rating scales to separ 
on different factors suggests that differentaspe 
of the teaching complex cannot be rated in à Mr cà 
to furnish reliable differences. For all prac o 
Purposes we may conclude that differences in 
rating scales were only semantic variations. 
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TABLE II 
Code Variable Loadings 
I II 

T Bernreuter Bs, Self-Sufficiency ‚55 . 04 

9 Washburne Social Adjustment Inventory . DL .48 
10 Rating of Teacher's Personal Fitness -.02 . 96 
11 Rating of Teacher's Personality . 00 . 95 
12 Rating of Teacher's Classroom Activities . 08 „91 
13 Rating of Teacher’s Personality .07 .94 
14 Rating of Teaching Skill 06 .90 
18 Social Attitudes Test .25 .38 
22 Test: Recognition of Pupil Problems .40 .04 
23 Teacher Socio-Economic Status -.62 .14 
31 Pupil Gain .84 37 


Using pupil gainasacriterion, Rolfe by mul- 
tiple regression found those variables which were 
the significant predictors. There seem s tobe 
little resemblance between the predictors of his 
study and the factorial composition of the pup il 
gain factor of this analysis. 


The Remaining Factors 


As in the Rostker analysis, the remaining 
factors represented dimensions in the teaching 
complex which were unrelated to the criterion 
variables of teaching efficiency. Because of this 
lack of relationship to the criteria, these factors 
will not be described beyond an arbitrary name 
which seems to this writer most descriptive of 
each factor. 

The remaining factors are: knowledge of so- 
esearch proclivity, personality, 
eaching, teaching intent, teach- 
class size, and school 


cial goals, non-r 
attitudes toward t 
ing preparation, salary, 
district. 


Summary 

Two criterion factors of teaching efficiency 
were found: pupil gain and ratings. Toa large 
measure these two factors were similar to two 
factors of the Rostker study. 


Factor Analysis of La Duke Data (45) 


Introduction 


e study was to de- 


The purpose of the La рик 
Es sept teacher tests and 


termine the validity of certain sts 
rating scales as measures of teaching efficiency 
When pupil change was employed as the criterion. 

Thirty-one teachers inoneroom rural schools 
Were studied. Approximately 200 pupils served 
to furnish the sample for examining the pupil 
change criterion. Classes were limited to 7th 


and 8th grades. 

A course of study, Community Living, was 
outlined by the State Department of Public In- 
struction. This course of study, consisting of 
eight units, was taught by all teachers according 
to a time schedule. Objective tests were con- 
structed to measure four hoped-for outcomes of 
instruction: appreciations, attitudes, informa- 
tion, and interests. The tests were administered 
at the beginning of the school year andagainatits 
end. To eliminate any possible ceiling effect for 
the better pupils and to controlfor intellectual dif- 
ferences, a pupil-gain criterion was produced by 
adjusting, regression-wise, the post-test scores 
for 1.Q., mental age, and pre-test variation. 

Five tests were administered to the teachers: 
the ACE Psychological Examination to measure 
intelligence; a test of the teacher’s ability to rec- 
ognize causes and symptoms of pupil maladjus t- 
ment and how the teacher would go about correct- 
ing these emotional problems; a scale measuring 
attitudes toward teachers and the teaching profes- 
sion; a scale of educational progressivism-c on - 
servatism; a social proficiency scale to measure 
*tconsideration for others’’. 

In addition, the teachers were rated with 
three different rating scales: ratings of classroom 
activities, teaching skill, and personality. The 
teachers’ superintendents rated them as well as 
their supervising teachers. A composite rating 
of the three scales for the superintendents and 
supervising teachers was obtained to furnish two 
independent assessments of teaching effective- 
ness. 

These data furnished a 12 X 12 correlation 
matrix. Four varimax factors were found, three 
being defined by some measure of teaching effi- 
ciency: pupil gain and rating. 


Varimax Solution (see Table Ш at top of next page) 


Rostker’s study indicated two facets of pupil 
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TABLE III 


ج کک 


Variable 


Loadings 
I Hi ш IV 


Pupil Gain, Appreciations 
Pupil Gain, Attitudes 

Pupil Gain, Information 

Pupil Gain, Interests 

Pupil Gain, Composite of Above 


-76 -.20 -.09 .38 
-68 ~. 08 .03 .56 
„TT .15 -.38 -.08 
. 15 .03 -.21 .78 


-76  -.04 -.28 (58 
Teacher's Intelligence (ACE Psy. Exam.) qq =I .14 -.20 
Understanding Pupils' Emotional Problems .54 ‚8з .29 -.07 
Attitudes Toward Teaching -.10 “=, 16 07  .57 


Educational Progress vs. Conservation - 18 
Social Proficiency, Consideration of Others 


Super intendent’s Rating 
Supervising Teachers Rating 


Pupil change were hypothesize. 


however, that there were only two 
- One type incorporated a Ppre- 
tion; the other 
attitudes. The 
ght have Suggested an alignment 


It is of interest to note that two teacher char- 
acteristics load оп Facto 


‚ 65 .28 -.13 
-. 09 . 00 .94 -.09 
-.03 .84 -.07 .02 
16 -.13 -.12 


1 
= 
о 


Conclusions 
ee usions 


. a 
By correlation and regression analysis, i 
Duke found little relationship between the thes 
and pupil gain criteria. The separation of is à 
Criteria on different factors in this a nalys "m" 
Well as in the two previous analyses Prol 
La Duke's findings. La Duke found that the Psy” 
er’s intelligence as measured by the ACE -elated 
chological Examination was significantly qe? 
0. 61) to his criterion of pupil gain. In this ache” 
ysis, we also find the intelligence of the а= the 
being related to a pupil gain factor defined by ^, 
Appreciation and information change variables, 
unrelated to any of the other factors. chins 
As in the previous studies, rating of tea ior: 
efficiency is unrelated to changes in pupil behav 


Factor Analysis of Lins’ Data (49) 


Introduction 
ton | 


r ti^ 

Lins collected data for the purpose of {ет 
gating the accuracy of predicting teaching effic ate 
as measured by ratings from measures colle 
during the period of institutional preparation. ert 

Correlations (Lins, 1946, Table XL) W 
available for 16 measures for approximately um 
women teachers. In Some cases, complete i on 
mation about all variables was not available; € ng 
Sequently the correlations are based on vary! 
numbers of cases. £2 

The criterion, Variable O, consisted one 
Composite of five Supervisory ratings of the pen 
€T While on the job. The correlative variab am^ 
Were: high school rank, ACE Psychological ee 
ination, reading ability, various grade ро 
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averages, evaluation of the teaching environment, 
practice teaching grades, prediction of teaching 
success from institutional data. 


Factor Analysis 


Four varimax factors were found forthe 
data. Table IV (see top of next page) presents 
the entire varimax solution. The code numbers 
of the variables are those used by Lins. 

Factor I is made up of variables which pri- 
marily reflect academic achievement. The cri- 
terion seems to bear little relationship to this 
factor. Factor II largely represents tested intel- 
lective ability. Again, the criterion bears little 
relationship to this factor. This is not incompat- 
ible with the Rostker study where the loading of 
the ACE Psychological Examination was moder- 
ate for rated teacher efficiency. Factor Ш іѕ a 
near-couplet, dominated primarily by an evalua- 
tion of the teaching situation. The negative rela- 
tionship between this variable and the criterion 
is explained by Lins as indicating that teachers in 
the less difficult positions were giv higher ef- 
ficiency ratings than teachers in the more diffi- 
cult situations. It is on Factor IV that the criter- 
ion has the highest loading. The dominant vari- 
able of this factor, however, isthe interview rat- 
ing. Predictions of teaching efficiency Írom both 
objective and subjective information have only 
moderate loadings on this factor. 


Conclusions 
pervisory ratings of teach- 


i iciency was found to be of complexity two. 
траен А it differs from the previous stud- 
ies. However, one of the factors containing one 
of its loadings was defined almost exclusively by 
a judgment of the difficulty of the teaching — 

tion. The complexity two of the criterion may be 
peculiar to this situation. The criterion Bad us 
highest loading in the interview rating P iie d 
14). The interview rating was made gt e 
teacher entered her teaching assignment A c 
being graduated from college. руш еап Eu. 
interview, the teachers Were заа ЫР ан 
Sional judgment, sociability, WOT ie tie 
al impressions, etc. This factor aa AST 
perhaps a comprehensive personalin v dear 
prospective teachers might be caruit 

predictor of subsequent rated teaching efficiency. 


The criterion of su 


Factor Analysis of Von Haden Data (80) 


Introduction 

oanswer the 
nterviews and 
n during the 


Von Haden's study attempted tc 
Question “Do materials such as 1 
autobiographies of students writte 


period of their institutional training contain 
information concerning qualities that are related 
to rated success in teaching? ” 

The subjects of this study were 58 women 
teachers. Seven measures were available for fac- 
tor analysis: 


1. Difficulty of the teaching situation. 


2. Interviews: two 40 minute interviews by two 
Staff members of the University of Wisconsin. 
The interviewers rated the subjects on per - 
sonal traits as adaptability, resourcefulness, 
energy, professional judgment, etc. A com- 
posite measure of these two interview ratings 
was made. 


3. Autobiographies: the subjects, while students 
in the School of Education, had written educa- 
tional biographies. These were rated by three 
raters. The same traits as under interviews 
were combined to give this measure. 


4. Interview digests: digests were made of the 
interviews and resubmitted to the raters, the 
subjects being anonymous. Ratings of the sub- 
jects were made on this basis. 


5. Two traits, initiative and professional judg - 

6. ment, were found to be correlated with super- 
visory ratings. These were used as separate 
measures. 


7. Criterion: This was a composite of five su- 
pervisory ratings of the subjects’ teaching ef- 


ficiency. 
Factor Analysis 


Three varimax factors were found for these 
variables, (see Table V on next page) 


Conclusions 


Factors I and III show that ratings of personal 
traits from interviews and from autobiographies 
yield different information about teachers. The 
criterion has loadings on both factors but is more 
closely related to interviews. This is consistent 
with the Lins’ analysis. “Initiative” seems to 
be the key characteristic of the interview meas- 
ure and professional judgment of the autobio - 
graphical measure. 

Factor II involves the difficulty-of-situation 
and the criterion. Theteachers of thisstudy 
probably are the same as in the Lins study. It is 
interesting to note the invariancy of this factor al- 
though different variables are involved in Lins's 


study and this one. I | 
In answer to Von Haden's question “Оо та - 


terials such as interviews and autobiographies of 
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TABLE IV 


Code Variable к ee - 
1 Evaluation of Teaching Situation ‚02 .22 ,0 E 
2 High School Rank .69 .36  -. Э. a 
3 English Cooperative Test 37 . 76 .29 E ба 
4 ACE Psychological Examination 18 -90 =.04 =. 11 
5 Cooperative Reading Test „1З ‚78 ‚15 in 
6 Predicted GPA (From Variables 2 and 3) „37 .85  -.12 i 
7 Freshman and Sophomore GPA ‚84 „84 .03 . 25 
8 Major GPA «ТВ 21 T + ОВ 
9 Minor GPA . 82 .15 -.09 . à 

10 GPA (In All Education Courses) . 86 28 -.01 . н 

11 Practice Teaching Grades . 86 .10 „10 -.0 

12 Prediction of Teaching Effects from 

Objective Information .68 „22 -.18 .40 

13 Prediction of Teaching Effects by Advisor 54 .22 -.08 .35 

14 Interview Rating .12 .10 -.04 .87 

15 Prediction of Teaching Effects From 

Subjective Data .45 = 10 .26 40 
0 Criterion: Rated Teaching Effects 22 .22 -.53 .61 


ТАВІЕ у 


M  — a U UU U 


TPO > co po =a 


Variable 


Difficulty of the Situation 


Rati; 
Rati 
Rati 
Rati 
Rati 
Rati 


ngs by Interview 

ngs by Autobiography 

ngs of Interview Digests 

ng of Initiative 

ng of Professional Judgment 
ng of Teaching Efficiency 


I 


.18 
. 86 
. 97 
.10 
.93 
.20 
. 53 


Loadings 


п 


„91 
‚05 
401 
2211. 
«09 
.23 
.65 


IH 


-.02 


.36 
‚87 
. 34 
‚15 
- 91 
. 27 


ل 


e < 


т 
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students written during their institutional training 
contain information concerning qualities that are 
related to success in teaching?’’, the answer 
seems to be ‘‘yes’’ for interviews. Autobiograph- 
ical material is identified with an independent 

factor which bears only a slight relationship to the 
criterion. The factorial similarity of the rating 
of initiative to the interview composite suggests 
that perhaps ‘‘initiative’’ is the key characteristic 
in the teacher's rating complex. Rating of pro- 
fessional judgment was factorially similar to the 

autobiographical factor. 


Factor Analysis of Jones's Data (42) 


Introduction 


Jones Table VI (see top of next page) had a- 
vailable 18 variables for correlation analysis. 
Two of these, Variable 0 and Variable 17, served 
as criteria of teaching efficiency. Variable 015 
a principal’s rating of the teacher’s efficiency. 
Variable 17 is a measure of pupil gain based on 
achievement tests administered at the beginning 
and end of a three month period. Finalscores on 
the achievement test were adjusted for pre-test, 
mental ability, and I. Q. differences. 

The other sixteen measures were intel- 
ligence, various grade point averages earned in 


college, experience, etc. 
Sixty-five teachers were studied. However, 


because of incomplete information, the correla- 
tions are based on varying numbers ofcases 
ranging from eight to sixty-five. The 
modal number of cases is approximately 54. 
Seven varimax factors were found. The two 


Variables having loadings in excess of 0.30 are 
reported in tabular form for these criterion fac- 
tors. The same code numbers as those used by 


Jones are employed. 


Factor 1 is defined by gain in pupil knowledge. 


As in previous analyses, ratings of teacher effi- 
Ene Have regbi loadings on this factor but 
serve to define another factor. The pupil gain 
factor fails to pick up the intelligence of the 
teacher as did the correspondent factor of the 
Rostker study. 

These two criterion 
variables r present no clear or 


factors on the remaining 
definitive picture. 


The Remaining Factors 


Factor HI was represented by high loadings 
on the ACE Psychological Examination, the Hen- 
mon-Nelson Test of Mental Ability, à reading ex- 
amination, and the General Culture Test. '"Intel- 
ligence” seems to be the description of this fac- 


tor, 
sisting of grades 


F и { соп s 
actor IV was a double ctice teaching 


earned in the methods and in pra 


courses. Factor V was defined by an activities 
and interest test and the Bell Adjustment Inv en- 
tory. Factor VI was made up of various grade 
point averages: total, freshman-sophomore, jun- 
іог-ѕепіог, and education courses. Factor VII 
was a specific factor of teaching experience meas- 
ured in years. 


Summary 


Seven factors were found to account for the 18 
variable correlation matrix. Two of the factors, 
as criteria of teaching efficiency, were of inter- 
est: change in pupil knowledge and supervisory 
rating. Although intelligence was included in the 
correlation matrix, it failed to appear on the pupil 
gain factor as in other studies. Achievement in 
formal education courses seemed to be the most 
relevant variable to pupil gain. 

The ratings of teaching efficiency failed to 
have anything in common with the teacher meas- 
ures. 


Factor Analysis of Erickson’s Data (24) 


Introduction 


Erickson factored 42 teacher measures for 
64 teachers. The variables consisted of 9 teach- 
er ratings, sevenscales of the Thurstone Temper- 
ament Schedule, the sixteen scales of the Cattell 
Persomality Factor Questionnaire, and various 
measures acquired during the institutional prep- 
aration of the teachers. His analysis was done in 
an interesting fashion. He formed multiple group 
factors on the basis of logical clusters found in 
the nine rating measures. Loadings were then 
computed for the remaining 36 variables using his 
clusters as the defined dimensions. 

It was decided to re-factor Erickson's data 
using the criteria employed for the other analyses 
of this report as wellas applying the varimax to 
the complete 45 variable matrix. Twelve varimax 
factors were found, two of which are presented in 
tabular form because they represent criterion 
factors (see Table VII on the next page). 

Factor I corresponds closely to Factor I of 
Erickson's study. Variable 18, PF-B, General 
Intelligence vs. Mental Defect, and Variable 29, 
PF-Q, Radicalism vs. Conservatism, had mod- 
erate loadings inthe Ericksonanalysis. However, 
in this analysis, the loadings of these variables 
were negligible. Rating of the teacher seems to 
be the only complex of this factor. 

Factor H only vaguely resembles Factor il 
of Erickson’s analysis. The ratings are about the 
same, but other teacher measures differ. On 
Erickson’s factor defined by Variables 5, 6, and 
7, the D-T and S-T scales of the Thurstone Tem- 
perament Schedule, the A, B, Е, Н, I, №, OQ 
Qs, and Q4 scales of the Cattell P-F Q uestion- 
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TABLE VI 

Loadings 

Code Variable I 11 
0 Principal’s Rating - M Blank .09 .98 
3 Bell Adjustment Inventory .43 .06 
6 GPA (Education Courses) :53 .21 
10 General Culture Test 90 „01 
13 State Department Rating -.41 .60 
15 Principal's Rating - C Blank .08 .95 
17 Pupil Gain, Achievement .88 .06 

TABLE VII 

Loadings 

Code Variable I II 
1 Principal's Acceptability Rating :87 .13 
2 Principal’s Rating, 1st Year .84 .03 
3 Supervisor's Rating, I .67 .08 
4 Supervisor's Rating, II .90 .04 
5 Principal's Rating, 2nd Year .39 .56 
6 Teacher Rating by an Outside Agency .46 .49 
7 Teacher’s Self-evaluation 021 7 
8 Rating by Other Teachers .14 .48 
22 P-F, Scale G, Positive Character -.12 .58 
31 P-F, Scale Qs, Will Control -.09 .53 


naire, and the practice teachi 
nificant (above 0. 30) loadings. 

This varimax factor seems Somewhat more 
definitely characterized by fewer variables. A 
conjecture might be made that the ratings of this 


factor are oriented toward the positive character 
and will controle] 


ements of the Personality make- 
up of teachers, 


ng grade had sig- 


The Remaining Factors 


» Cyclothymia vs. 
Schizothymia; P-F (E), dominance or ascendance 
vs. submission; P-F (I), emotional Sensitivity 
vs. tough maturity; P-F ( ), bohemianism vs. 
practical concernedness; and P-F (B), general 
intelligence vs. mental defect. 


Summary 


заелі 
Although Ericison found three factors т” only 
in the rating Scales, by the varimax еек И 
two factors were found in this analysis. 9 uite 
these factors resembles Erickson’s factor Y A 
Closely, the other only somewhat. Facto acto" 
volves variables that are largely ratings. evalu® 
П, however, best defined by the teacher's 


on 
tion of herself, has included variables of a P 
ality nature, 


Concluding Remarks ng 
: ей}. 
Seven studies containing criteria of ae pint 
effectiveness and other variables of the met? 
complex were factor analyzed by the хае, 
od. Certain general conclusions may be y 
sant)? 
1 iteri ing efficie? gt 
> The two general criteria of teaching е! almo 
Pupil change and rating of teaching, in 
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all studies tend to become markers as definers 
of factors. The emergence of these variables 
as the key definers of factors was unanticipated 
at the beginning of the study. Thereis nothing 
in the factorial method that should artificially 
produce this result if the criteria were nt 
logical definers of the domain. 


Pupil gain factors bear no relationship to rat- 
ing factors. 


There are at least two kinds of pupil change 
occurring under the influence of the teacher. 

Rostker's study indicated that these might be 

representative of informational and non-infor- 
mationalchanges. However, La Duke's data 
failed to substantiate this structuring, although 
two change factors were found. La Duke’s 
data suggested that the conception of pupil 
change as of four kinds: appreciations, atti- 

tudes, information, and interests, in an over- 
simplification of complex academic c hanges 


occurring in pupils. 
aching efficiency were 


er, Erickson's data 
naddi- 


In general, ratings ofte 
unidimensional. Howev 
indicated that self-ratings might be а 
tional criterion factor. 


Of the many correlative variables in these 
studies, only a few, andthese notconsistently 
So, bear relationship to the pupil change fac- 
tors. Among these were: the teacher's intel- 
ligence, attitudes, ability to recognize, diag- 
nose, and correct pupil's emotional problems, 
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and the teacher's knowledge of the subject mat- 
ter. It should be emphasized that these vari- 
ables were neither consistently nor highly re- 
lated to the pupil change factors. In general, 
objectively measured personality character- 
istics were not found on pupil change factors. 


The rating factor remains enigmatic. In gen- 
eral, few correlative variables were related. 
However, the evaluation of teacher's future 
proficiency by interview seems factorially bet- 
ter than by evaluation of autobiographical in- 
formation. 
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CHAPTER VII 


А NON-ADDITIVE APPROACH TO THE MEASUREMENT 
OF TEACHER EFFECTIVENESS 


LELAND E. JENSEN 


Many attempts have been made to develop val- 
id and reliable measures of teacher effectiveness, 
none wholly successful. The difficulties may re- 
side in any number of related areas of which the 
following appear to be most salient: a) prevailing 
theoretical constructs of human abilities, b) the 
elements of Success, if there are such, that the 
researchers project, c) the measurement instru- 
ments which have been employed, and d) in the 
Criteria of teacher effectiveness. There is trou- 
ble but no one is quite certain where it is. 

This paper aims to explore a non-statistic al, 
non-additive hypothesis which brings into question 
the statistical approach SO generally employed in 
the study of teacher effectiveness. The hypothe- 
Sis to be tested is that good teachers possess, to 
à greater degree, the characteristics deemed im- 
portant by those making the evalu ation, than do 
average teachers. The good teacher may be out- 
standing on only one quality, but his range on the 
other qualities must not drop below the critic al 
level. The Superior teacher will have more high 
level competencies among the variables than will 
the average teacher, 

This hypothesis asserts that there are a limit- 
ed few uncorrelated critical elements out of which 
Success and failure may arise and that good teach- 


her who may have 


superior ability in many respects but one who has 


one or more critical deficiencies, The attention 
is focused in this Survey upon the extremes of the 
distributions and the patterns of efficiency and in- 
efficiency. 
The uncorrelated qualities Which will be tenta- 
tively identified for testing are as follows: 
1. Academic aptitude— scholarship andcompeten- 
cy in area of specialty. 
2. Professional adequacy— 


knowledge of pupil de- 
velopment, learning, 


and teaching methods. 


rela- 
3. Personal acceptability— skill in human aie 
lations, teacher-pupil relations, adminis 26 
tive acceptance, peer evaluation, grouP 
bership and leadership. I 
4. Motivation and interest inteach ing eê 
economic sufficiency, and family و‎ 
5. Physical attributes—health, psycho- 
ability, and energy. : 
With this hypothesis in mind, a iiber © 1ê 
studies here summarized will be re- exa es, with 
through the use of non-correlated techniqu d po 
a view to ascertaining whether good oa pos" 
teachers conform to the hypothesis state ib to 
Sibly from this approach it may be poss which 
find a limited few definable characteristic od an 
might be used to differentiate among & 


— socio" 


f the 


to SUP. 
poor teachers. Levin (5, p. 35)* See. for dif- 
port this view. He believes that epe diem y 
ferent criteria must not be summed indi ‚ and 


ately; that the criteria should be pam rir 
that relationships should be sought for 5 n of 
terion independently. By noting the ! a nu 
Scores on various measures according to to 67 
ber of criteria, it should then be possible 


veli 
agat hic 

velop a better schema of the qualities on 
Superior teachers appear to excel- | па non^ 
In order to explore this hypothesis fror yy 


u 
Statistical approach, three of the most car x 
constructed factor analytic studies wer “asta 
for which there were relatively complete r 
all the subjects. From each study, the fou eter” 
and the four least capable teachers were n 
mined on the criteria used by its author ined P 
numerous measures were then re- exa a 
determine if there is support for thehypO" q of 
Although an analysis of the 48 cases sele Р» 
the five criteria used in the studies will n ge? 


с 
tablish the hypothesis, there were enough 
to disprove it. 


Example 1 


The data for the first analysis are draw й 
Von Haden’s study (9, p. 61). His thesis per ion 
ed to the use of subjective qata and its re by: 
Ship to future teaching success as measure’ jeet 
Composite of five supervisory ratings: 


2 


* Reference numbers in this particular chapter refer to references at the end of this chapter. 
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ings were held of the evaluative staff com- 
posed of a methods and a professional course 
professor from the University of Wisconsin, 
two supervisors from the State Department of 
PublicInstruction, and the principals involved, 
to establish standards and unifo rmity in the 
use of the rating sheet. 

2. Evaluation of teachers by pupils: The pupils 
were asked to rank the teacher under evalua- 
tion as compared to the other teachers the 
student had. 

3. Residual pupil gain: Two tests, separated by 
an interval of six months, were administered 
to the pupils in the respective subject areas. 

These evaluations were made during the latter 

part of the first year of teaching. The basic data 

for the eight teachers on the three c riteria are 
presented in Tables I, Il and III with the code 
numbers for the teachers as used by Von Haden. 

The criterion of residual pupil gain is shown in 
only Table III because, of the 48 teachers in the 
sample, only 17 were evaluated on this measure. 
So few of the teachers sel ec ted on the other two 
criteria had been involved in the pupil gain testing 
that it was not practicable to limit this study to 
those teachers who had been evaluatedon all three. 
However, as will be discussedlater, the correla- 
tion among the three total groups on each criter- 
ion was so insignificantly positive that it does no 
harm to our present exploration. 

It should also be noted that there are three pri- 
mary sources for the data, other than the criter- 
ia evaluations, which are: 1)Two one-hour struc- 
tured interviews conducted by two members of the 
staff of the School of Education, University of 
Wisconsin; 2) A detailed twenty-page data booklet; 
and 3) Student teaching evaluations by the super- 
visory staff. These data were collected whilethe 
subjects were seniors at the University of. Wis- 


consin. 
Let us first exa 
the teachers select 


mine the hypothesis regarding 
ed on the basis of supervisory 
ratings. As could be predicted from the sources 
of the data, there appears to beahigh order of 
agreement between preservice ratings and super- 
visory evaluations in the field. Ce rtainly con- 
stant working with teachers and teacher candi- 
dates should develop some commonalities among 
professionals in their concepts ofa A good teach- 
er. However, this does not minimize the extent 
to which the good teachers surpassed theless able 
teachers on many separate ratings by profession- 
ally trained “experts. ”” | 
тег noting ie general direction of the differ- 
ences, it becomes evident that some of the least 
able teachers on the criterion уеге rated higher 
than some of the best on the various qualities. 
This, however, has already been hypothesize d. 
The important issue is how low can 2 high level 


teacher fall on any of the measures before becom- 
ing ineffective. Teacher 5, who was most effec- 
tive on this criterion, had the lowest score of 2.7 
on Considerateness. Since none of the better 
teachers had a score below 3.0, two questions a- 
rise: a) Is considerateness a critical factor? 
And b) where is the cut-off point? 

Referring to other studies summarized within 
this monograph, such as Barr (1l, p. 185), Hell- 
fritzsch (3, p. 166), Lamke (4, p. 217), and 
Schick (7), there appears to be evidence that con- 
siderateness is a critical factor. For example, 
in measuring personality factors, Hellfritzsch 
found that teachers possessing liberal social be- 
liefs tend to produce greater pupil growth. Barr 
and Lamke, in separate studies, found that good 
teachers, more than poor, are more likely to 
have abundant emotional responses and empathy 
toward another's problems. However, when com- 
paring the rating of 2. 7 on considerateness with 
the ratings of the poor teachers and with the pupil 
evaluation criterion, it is not clear if it is below 
the critical level. 

Examining the data for the least able teachers, 
one finds a number of scores which apparently 
fall below a decisive cut-off point. Teachers 4 
and 58 tend to substantiate the hypothesis if their 
numerous scores below 2.7 are on critical quali- 
ties. They are particularly low on General First 
Impression, Initiative, Professional Judgment, 
System of Values and Work Habits. However, for 
Teachers 53 and 47, thecase is not clear. Teach- 
er 47 had a score of 2. 3 on Energy and Initiative. 
Teacher 53 had only onelow score of 2.7 on Pro- 
fessional Judgment and yet was se lected as the 
least able on the criterion of Supervisory Ratings. 

On this criterion, there appears to be a num- 
ber of qualities, some relatedto eachother which 
differentiate between the two groups. General 
First Impression by theinterviewers seems to be 
the strongest of these. Work Habits, Profession- 
al Judgment, Adaptability, System of Values, En- 
ergy, and Initiative are digest evaluations which 
appear to be consistent with only a little support 
from the student's actual report of the Hours 
Studied per Week. The supervisors rating of 
Practice Teaching and the subject's self- report 
of Participation in Extra-Curricular Activities in 
high school also gave a strong indication toward 
which group a particular teacher wouldbe classi- 
fied. Although the Percent of Total Expenses 
Earned by the subjects and their self-appraisalof 
Health were in the same direct ionas the other 
measures, it is difficult to establish if any level 
within the range is critical. 

When applying the criterion of pupil evaluation 
(Table II), it is apparent that the directionality of 
the differences between good and poor teachers is 
not as consistent as in the case of supervisory 
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ratings. Also, the range of the ratings between 
the averages of the measures for the two groups 
was, in most cases, not as great. Yet the stu- 
dents chose teachers as superior who were rated 
markedly better on the first criterion. One u- 
nique element was the shift ofthe practice teach- 
ing rating by the instructors inthe field. The 
least able teachers were rated superior to the 
best by the cooperating teachers. Itisalso of in- 
terest to note that the interview ratings on socia - 
bility of the least able teachers were superior to 
the best teachers, although not markedly so. 
Could it be that these two evaluations are not spe- 
cific for effective and ineffective teachers? 

There appears to bea number of evaluations 
which differentiate between the two groups of 
teachers to a marked extent. Asunder supervis- 
ory ratings, General First Impr ession appears 
to discriminate between good and poor teachers 
selected by pupil evaluations. ProfessionalJudg- 
ment and Work Habits, as rated from the inter- 
view digests, are in strong agr eem ent with the 
criterion. The subjective data from the student 
booklet again show a consistent indication withthe 
appraisal being the only self-evaluation which is 
more significant than were the measures on the 
first criterion. 

Teacher 38 was the only carry-over fromthe 
first criterion. However, 38 maintainedthe sec- 
ond best position and no teacher from the previous 
analysis appeared in a reverse pos ition on the 
continuum from best to poorest. It therefore 
seems that none of the most able teachers on the 
first criterion had a critical deficiency on the 
second. From the standpoint of supervisory гаг 
ings and pupil evaluations, the hypothesis has no 


a n refuted. : Р 
i Lopes interesting finding concerni ngthe 
pupil gain criterion 


teachers selected on the 
(Table III) is that those who producedgreater pu- 


i i i tly superior to 
il gains were not rated consisten 
the js pupil gain achieving teachers by the pupil 
For example, Teacher 48 


evaluation criterion. 5 
received the lowest rating of all eight teachers on 


the pupil evaluation criterion and yet scored third 


highest in residual pupil gain of the 8 een 
employed in this phase of the study. Fur 


more, the difference between the two eligible. 
the supervisory criterion ratings uos T x eim 
This seems to support the belief tha i ның d 
who are held in high esteem by the stu e pus 
not necessarily Produce ban im Umen 
academic de ment of their n 

A cloner ҮТ the individual ratings с Lg 
teachers on the supervisory ratings criterion 


i " i Teacher 4,that 
s with ihe een observation of 


composite ratings gained t j = 
teachers in eis regular glass W Ni c 
liably separate those teachers Who P 


perior pupil gains. The inconclusiveness of a 
comparison among the three criteria measures 
employed is even more striking when the corre- 
lations among them are studied. 

The highest correlation coefficient is .281 be- 
tween pupil evaluation and Supervisory ratings. 
This can hardly be viewed as a Significant cor- 
relation. It would appear that different aspects 
of a teacher's effectiveness are measured by the 
three criteria. Therefore, qualities which are 
consistent factors in distinguishing between good 
and poor teachers on all three criteria should 
represent these different components of teacher 
efficiency. 

Let us now examine the differences onthe 
subjective measures. There are four averages 
which favor the less able teachers; namely the 
Supervisor's Practice Teaching Grade, evalua- 
tion of Social Adequacy, Participation in Extra- 
Curricular Activities, and appraisal of Health. 
Of these, попе are more thantwo-tenths of a 
point better than the more able teachers. On the 
measures where the best teachers in promoting 
pupil gain were superior, only General First Im- 
pression, Instructor's Practice Teaching Grade, 
Professional Judgment, and Work Habits were 
greater than three-tenths of a point better than 
the least able. 

The differences betweenthe best and the least 

able teachers appear to be minimized because of 
the few teachers evaluated onthiscriterion. And 
yet, the items that most strongly differentiate 
between the two groups seem to be consistent 
with the results of the application ofthe first two 
criteria. None of the superior teachers had an 
evaluation on the interview and digest material of 
lower than 2.5. However, ofthe four less able 
teachers on this criterion, only Teacher 4 was at 
or below this cut-off point on more than one rat- 
ing. 
p the student data booklet, only the Per- 
cent of Total Expenses Earned while in college 
maintained the same directionality of the first two 
criteria. The less able teachers reported slight- 
ly greater Participation in Extra-Curricular Ac- 
tivities, higher appraisal of Health, and signifi- 
cantly more Hours Studied per Week. 


Conclusion 


Although the evidence from the application of 
the criterion of residual pupil gain was somewhat 
ambiguous, the measures which most strongly 
differentiated between the best and the least able 
teachers were almost identical to the first two 
findings. Teachers 4 and 38 were included in two 
of the tables and, in both cases, remained in ei- 
ther the most able or leastable group. The evi- 
dence from the original study indicates that, if a 
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lar Я 
EE group had been included to represent the 
Sisi mes, more teachers would have been con- 

E selected. 

os Ap ccce use of subjective data, as it re- 
басе three criteria of teacher effectiveness, 
E to indicate that a number of judgment rat- 
Soo fe differentiate between superior and aver- 
Bn Im The more able teachers, by his 
of the 2 were awarded higher ratings on most 
easur i E d 
ratings. es and they had decidedly fewer low 
dc factors which did discrimina 
under the following qualitative 


te can be as- 
headings: 


Pr ү 
ofessional Adequacy Personal Acceptability 


Pro = 
oe Judgment General First Impres- 
тусо practice «pes 


T : 
ies Rating Initiative 

Siructor's Practice 

eaching Rating 

Physi 
i eg Motivation 

r — 
Heal Rating percent of Total Ex- 

Self- Appraisal penses Earned 
participation in Extra- 


Curricular Activities 
work Habits 


it as administrative decisions have to be made, 

ities n that judgments relative to these qual- 

candida 1 be helpful in selecting the more able 
ates from a group of applicants. 


Example 2 

ote E ata for the second an 

ins ae thesis (6, р. 2). 
ich Los part of a teacher € 
h intensely studied many 
ing ma as they progresse 
Ployeq m nd The population an з 
tudy y Lins were identical to von Haden'$ 
data’, However, Lins inclu 

Avera high school record, 
Rating and the results of 
Staff gs were also made by the 527 
the Pie the University of Wis¢ concerning 
amaa candidate's worth as 2 Di 
я ете аре t Counselor; р 
ы the wird dee ia are identical to 
e sample and CI iteria аге ot the ashe 


ded such ob 
vario 


Xam 
as Ple 1, the eight teachers in b 
sd in Tabi and үп ате also the Sam Tee 
, F fore 
E: үк ые oe een mitted. 


es 
ë aint the three criteria have 
vites ine first the directionality of үт and 
Tr, „tween the two groups in Tables v, 
Pen 1 n 


i 
S somewhat surprising (0 


pattern is almost identicalto t i 
ple 1. Even though the m e ri y ОГ 
same, the teachers selected as most able by the 
three criteria generally surpassed the less able 
ae The F spread between the two 
roups is again found o r vi A 
negn lo nthe supervisory rating 
As is evident from a careful study of the re- 
sults on the college norms of the Henmon-Nelson 
and American Council tests, the case of teacher 
intelligence, as purportedly measured by achieve- 
ment tests, are quite contradictory. The super- 
visory team selectedthose teachers as best who 
were five to seven points above those selected as 
less able. Conversely, the teac hers who were 
selected as best by the pupils were s ixto eight 
points inferior to those chosen as the poorest. On 
the criterion of residual pupil gain, with a much 
smaller population, the difference between the two 
groups was negligible. Therefore, it appears that 
there is little evidence to support the use of an in- 
telligence or achievement measure inthe selection 
of teachers if they meet the academic require- 
ments and succeed in making normal progress 
toward graduation. 
Moving to the measures involving academic ap- 
titude, such as the candidate’s grade point in the 
total college career, major and minor fields, and 
professional education, the differences are more 
clear-cut. The more able teachers, as selected 
on all three criteria, surpa ssed the less able. 
particularly on Total Grade point, most of the 
superior teachers completed their college careers 
ge in excess of C plus. 
Teacher 28 on the criter- 
None of the teachers se- 
supervisory ratings as 
f much below 


The only exception was 
ion of pupil evaluation. 
lected on the criterion of 
most able had a total grade point o 


the B level. 
The remain 
ice Teaching 


ing two objective measures of 
Grade and percentile Rank in 
hool Graduation Class tended to differen- 
tiate between the two groups in the same manner 
as the other professional indices. The most 
striking finding is that the su pervisory criterion 
identified those as Superior who had received A 
in Practice Teaching. There were also 
ther two criteria who re- 
ceived an ing than in the less able group. 
None of the superior teachers, on all three cri- 
teria, was awarded a grade below a B in Practice 
Teaching. Therefore, it appears that a grade of 
C, as awarded by the University of Wisconsin, is 
e cut-off point for effective teachers. 
of the two one-hour interviews, as 
fthe candidates as Direc- 
Student Counselors, and Mem- 
chool Staff and Community, also 
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TABLE V 


RY 
CRITERION OF SUPERVISO 
RVICE DATA AS COMPARED TO THE 3 

m o FOR FOUR BEST AND FOUR LESS ABLE TEACHERS 


E 
© 
A " v E > 
ы E Ф Е 3 
Puri Д Š B Е ы E 5 
9 o 5 A, Ë a, о | =I H 
= F A o в н fa] 
o Ф v ap ë © g 
O =“ 9 © © E 4 H E Q 5 
Oo = d d @ = a o ° o O 
Б g S S [5] fa 9 @ кы] 2 [7] 
o 5 H o [6] a = ча 
a o Ü d o a Sa E a o 
о Ü x 3 8 g E о © 8 а 
2 9 o o 8 Ë н Ф 
с g im 9 4 Ф Š 43 Ф a 
n q n = [7] о o2 35 = a 
6 8 $ 8 a h = а ° E Б B 
83:8 8 g £ 8 > ЖЯ E 3 z 
S57 8 & 3 ER B à Š 
Four Best 
No. 
5 51 56 1.9 
38 60 52 2.8 
9 60 60 2.8 
16 47 53 1.9 


Four Least 
No. 


53 53 48 2.0 
4 44 48 1,4 


47 51 50 1.6 


* Ratings have been ro 
** Arrows indicate whi 
Note: Data extracted 
tion, Universi 


unded to the nearest tenth, 
Ch group of four averag 


С ed higher on Particular measures. 
from Lins, Leo Joseph, The P. 


n. D, рїззег!#' 
rediction of Teachi Efficiency, Ph.D. 
ty of Wisconsin, 1946. ق‎ ESfioteniy, 
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TABLE VI 


PRESERVICE DATA AS COMPARE 
D TO THE CRITERION OF PUP 
FOR FOUR BEST AND FOUR LESS ABLE oe ا‎ 


E 
o 
- A ° 
° = £ o = = 
? P 3 à P a B 8 E 
= F a i Š Ri o E ë = 
о = Ф ч 5 1 bp g m m Ë 
с Е a n s @ Z r: 8 2 8 
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2 с © 0 5 ° E о 6 © i = 
1 a 3 rad @ E o 8 [9] S 
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o E o [^] 2 о 8 = oO © 
Ë [| £ B o н p m © а 2 
£ v Ф > © 2 El 8 o © Е 8 
o E n s I" Ç É Ы E 3 © © 
Four Best m: r- 2 ñ E а m a B = RB 
No. 
21 48 50 15 1.4 14 15 20 57 32 3,9. BO 8:9 
38 60 52 2.8 28 3.0 29 30 67 45 45 4.0 47 
28 A 5 ns 20 1 LT 20 6 23 27 33 27 
43 si 52 19 19 20 20 20 6 37 38 4.0 4.5 
Best mox M "L9 1.9 2.0 20 22 6 34 37 38 37 
Least rene 38 Tx ip» asp Uu 06 йз % 3 0 
Puede J фуд. TOUT OT se secet 
No. 
29 59 52 1.8 18 20 1.7 20 60 33 27 3.0 2.7 
ar p go is & 36 Lf £6 Salt ir at at 
37 по 62 24 23 24 27 до 67T 20 20 33 3.3 
24 63 64 1.5 13 L7 20 20 55 27 30 $8. 9.9 
rc ишш SE" ME vi w& 20 4 Ls 4 ВІ Эй 
nearest tenth. 
ticular measures. 


E: Ratings have been 
Arrows indicate W 
Note: Data extracted fro 

Dissertation, Univ 


hich group 
m Lins, 


rounded to the 
of four averaged 


ersity of 


higher on par 


The Prediction of Teaching Efficiency, Ph. D. 


Leo Joseph, 
Wisconsin, 1 
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TABLE VII 


PRESERVICE DATA AS COMPARED TO THE CRITERION OF RESIDUAL PUPIL 
GAIN FOR FOUR BEST AND FOUR LESS ABLE TEACHERS* 


€ 
5 
+ pi o 
o bes - E v = © = 
PU š 33 š Š 3 2 
= ё & [s 5 & о be [2] 5 
9 а o o o bp ‘A н a Ë 
s 9 3 9" < 9 3 # à 3 3B š 
S 5 3 5 BOR 9 S 9 E © ° 
a 8 © o a © 9 = m 2 a [9 
g О н 3 £ š É 3 з 8 = 5 
1 8 2 a 9 n ° [6] 
in Ф = H н н 
£ © g = n < o © © = © 9 
9 ж н a 3 = o 9 5 2 i| 
H @ E © * ө © 5 Ф © Б B 
© 8 a g 9 „ЫШ 8 E H E er Ч 
Four Best T < = 2 а Z a m e 4 à " 
No. 
8 72 73 3.0 3.0 3.0 3.0 3.0 73 3.2 2.0 2.0 2.5 
55 63 48 LS 1.8 2.2 1.9 23.0 70 4.0 3.8 3.9 3.0 
48 39 43 1.5 1.6 2.0 1.6 3.0 56 3.2 3.2 3.5. 8,5 
34 54 46 1.5 iT 1.8 1:2 2.0 T3 3.0 2.8 2.7 2." 
Best Ave. 57 53 2.0 2.0 ae 1,9 2,8 68 3.3 2.9 2.9 2.9 
Least Ave. 56 55 1.5 1.6 1,9 1.0 2,2 55 952; 2. T 3.0 2.8 
СИ Е лт. 
Four Least = | CZ MM 
No. 
57 56 64 1.5 1.2 20 1,5 2.0 56 4.5 3.2 2,2 8.0 
26 60 52 1.4 1.6 138 2,1 2.0 55 9,19 3.5 3.7 2.8 
4 44 4 14 LT 15 LI 20 45 15 10 2.5 2.0 
41 63 58 1.9 1.8 2;3 1.8 80 65 3.0 3.2 Bib 3:5 
Least Ave, 56 55 1,5 1.6 1.9 16 2.2 55 22 27 3.0 2.8 


s Ratings have been rounded to the nearest tenth. 
Arrows indicate which group of four averaged higher on particular measures. 


Note: Data extracted from Lins, Leo Joseph, The Prediction of Teaching Efficiency, Ph.D. 
Dissertation, University of Wisconsin, 1946. 
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a ci would be rated. A rating below two 

able ызы to cast a teacher into the less 

hypothesis tha This gives further evidence to the 

cial i о that a good teacher must have the so- 

inter lities deemed necessary for success in an 
actional setting. 


Conclusion 


шару application of the results of intelligence OF 
didates Е tests to the selection of teacher can- 
ings, ану not seem warrantedírom these find- 
have me is assumes that the teacher candidates 
institutio the requirements ofthe teacher training 
tors a on and are certified. The important fac- 
and Ан main be the level of success in academic 
en agen course work. 
abilities ates who possess average college-level 
е more and are superior іп cours work seem to 
Perior effective teachers th an do mentally Su- 
is ieee who did less well academ ically. 

0 We not to say that highly capable students, 
Seleoted ; academically very successful, were not 
criteria as being able teachers by these three 
Whether q Superior college academic achievement, 
appears ue to intellectual or motivational factors, 
data, to be the best indicator from preservice 


T 
he practice teaching grade. peren nially а 


Con 
is тохеғаіа] index of later Success, did serve in 
fast py to differentiate between the pest and 
еге o E teachers. However, the two groups 
criterio y markedly different on the supervisory 
The 2 
на балп Subjective ratings from the interviews with 
follow didates, prior to their accepting positions, 
Brade ed a pattern similar tothe practice teaching 
Charact he prospective teac hers did exh ibit 
Fs €ristics which the professional interview- 


w 
duce STe able to recognize as more likely to pro- 
is defined 


кы bein ess. Success, in this sense, ned 
evaluat Selected by the supervisors’ and pupils 
Lamke’ as an excellent teacher. . ,. I 
E р. 214 5 findings are cogent to this discussion 
opnalit 7). Tn a study involving t 
to the а traits, he concludes that afactor analysis 
for gogg a {indicates that several patterns exist 
se lik and poor teachers. ood teacher 
eo to be gregarious, а yenturous, à 
teo 8 a: have abundant e m otional res ponse "à 
[sis = rtistic or sentimental interests. to be in- 
goaa dio E the opposite sex, to 
to [^ or Wired teachers are m? А 
Ck е S to be shy, cautious, Cr Е 
intere, inn otional responses and artistic or sent 
s 


friv- 


n 

in rests, to have a CO 

te е opposite sex. to 
a an . 
Cherg, 1d more attentive to рео 


Adapting the results of Lins’ dat 

i 1 : a, as pr - 
ed from the view of the extremes, to ie pos 
thesized qualitative headings, the following ne 
tors should be considered in teacher selection: 


Academic Aptitude Professional Adequacy 


Practice Teaching 
Grade Point 

Professional Education 
Grade Point 


Total Grade Point 
Major Field Grade Point 
High School Rank 


personal Acceptability 


Interview Ratings 


Example III 


analysis is extracted from 
tz (8, p. 63). His investiga- 
tion concerned the measurement of primary 
source traits, as defined and developed by Cat- 
tell (2) to determine their value as a predictor of 
teacher effectiveness. The subjects were agroup 
of thirty-four seniors consisting oftwenty women 
and fourteen men enrolled inteacher education at 

the University of Wisconsin. 
The data-gathering devices were nineteen ob- 
jective tests of primary source traits, measuring 
onality. developed by Dr. R. 


ten factors of pers 

B. Cattell and Schwartz. From this battery, the 
results on nine tests which purported to measure 
factors used in the investigation 


d by the same method employed 


The third pattern 
the thesis of Schwar 


in the first 


that they would be the m í 
in identifying the best teachers on hiscriteria. 


From the implication ofthe usefulness of subjec- 
tions of personality factors in identi- 
st able teachers in the previous ex- 
it is hoped that objective measures of 
personality traits would further strengthen a non- 
additive pattern approach to the prediction of 
teacher efficiency. 

The tests of the six factorsof personality, us- 
ing the numbering system of Schwartz, are as 
shown at the toP of page 85. 

Three of the five criteria employed by 


Schwartz, for which sufficient data were avail- 
able, will be used to select the teachers for this 
analysis. ey are Student Teaching Grade, 
"onal Grade Point, and Total Grade Point. 
Tables vill, IX. and x present the findings of 
these criteria as applied totheteacher personal- 


К measures. š ; 
ity istency of the direc tion of the first 


e consis J 
Th s on all three tables is the first apparent 
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TABLE VIII 


PERSONALITY DATA AS COMPARED TO THE CRITERION OF STUDENT TEACHING 
GRADE FOR FOUR BEST AND FOUR LESS ABLE TEACHERS* 


T T I 
Total 
Primary 
Traits 


Criteria Individual Tests 


Professional Grade 
/3 


Point Average 
1 a Humor Judgment 


3 b Suggestibility 
to Authority 

9 a Reaction Time 
10 b Perseveration 


Point Average 
5 c Fluctuation 


of Attitudes 
8 a Willingness 


Total Grade 
1 b Tempo 

3 a Logical 
Assumptions 
Consonant/ 
Dissonant 
to Modify 


Top and 
Bottom 1 


Four Best 


Directions | Jb KR TA KAI reer asia E eR i 


WouptessB | == | of т aR аа 
Rating No. 
1 14 

2 — 17 м 49 22 21 48 з 3.7 
3 

» 30 и п 49 4 22 35 23 49 

3 26 

3 14 16 3 13 от тв xi 3⁄4 
3 30 
PSP Beda 8 3567 1 ae оу g M ME NE 
Least Ave. " . 5 1i | os 44 "IUMMM------------.----2-----0 É 


d hi ч 
Note: Data extracted from Schwartz, Anthony re Stud rhe т mensuren, 
к 


Objective Tests of the Primary Source P. 
University of Wisconsin, 


ersonality Traits o Teachers, Ph.D. Dissertation, 


NSE 
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TABLE IX 


COMPARED TO THE CRITERION OF TOTAL GRADE POINT 


FOUR BEST AND FOUR LESS ABLE TEACHERS* 


PERSONALITY DATA AS 
AVERAGE FOR 


Individual Tests 


Criteria 


n 
£ 
9 3 
= = Ë 
Е р. d 
o = ° Е £ ч o 8 
"е a £ B T © 5 Б 3 
Ë É g| ë 2 š s 8 Ë b 
а Ор 9 El < Ë a = g g g 
ч = " = a Iz - 
$38 5 3 2. 3 p g Š 
° 58 a 5 8 © a> Ba Hb 5 a 
oo ° = = Б © = = © н 
к => £ Е Sb == š оо sd 9 Е 
[^] e s Š Dh 5 23 s= © ñ 
а at Se 3 Ф ФО FË ES e 
a ME B ë а BB B ба ая s 
яя g q os о ө" n q 
g oZ e. d a 5 & о о 
B RO E ё vá E © as о о of o = 
б BR 


* 
le number. 
+ Ratin arest tenth OT wh icular measures. 
Ar one have been rounded to by к averaged higher on m: the Discriminating Efficiency of Certain 
Note. "S indicate which ETOUP 9, riz, Stud atts of Teachers, Ph.D. Dissertation, 
DY 


on extracted from SC apy 
Ú Jective Tests of the prim 
niversity of Wisco. 


nsin, 
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TABLE X 


PERSONALITY DATA AS COMPARED TO THE CRITERION OF PROFESSIONAL GRADE POINT 
AVERAGE FOR FOUR BEST AND FOUR LESS ABLE TEACHERS* 


Total | Е 
Ргітагу 
Criteria Traits | Individual Tests = mee” 
n = 

& | Eo: B TTE 
" s Hx 8 
š Ë Š а š S а p Ё 5 
za ° б Е z = 2 S 8 5 © 
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B SO e B 9 < 7 ES E EX z 5 
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Four Best a её e El Ns = S aS 5: of « о Š E 
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8 
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Factor I 


ka Z vs. Schizothymia 
i a Judgment of Humor 
b Tempo (Natural Speed) 


Factor III 


Emoti р | 
wy re Maturity vs. Demoralized E motion- 
; a Inability to Select Logical Assumptions 

b Suggestibility to Authority 


Factor V 


cholic Desurgency 


Su 
Tgency vs. Agitated Melan 
issonant Statements 


5 a Ratio: Consonant/D 
5 Recalled 
с Fluctuation of Attitudes 


fina: 
ee Columns 1 and 2 indicate the extent to 
ich the criteria agree withone another. It ap- 


Dear er. І 
Pears that teachers selected onone criterion wil 
However, al- 


e 
ud be chosen by the other two. oe 

ith h no teacher was selected in the bes gro р 
minus Student Teaching Grade below four, а E 
Grade’ Teacher 5 in the low grou on Z beu 
ing a point was awarded an A in Student mo 
mie earned a B plus in professional ra - 
meas, Therefore, it appearsthat nO one of hes 
but рге, used as a criterion, can be suppor = 
пае aie, an assessment scheme mus 

all three. 

times’ next two columns represent the number of 
third a particular teacher was in the OH 
tive «O, bottom one-third on all nineteen obj ° 
tests of surface traits used in the origina 


me ejt 
Would Schwartz (8, p. 76) concluded that 


= ounce 

тај. SEEM tha c who have more pron 

aits t thos quem inan 
Ose , 


did a better job in student tee А 
аррез i were rather ‘colorless’ individuals T: 
we ars that this conclusion holds true га 
les а criteria when analyzed by four e 
е extremes. 
appen test 1 a-Humor Judgment, there dost Te 
Seems to be a consistent pattern: This mant 
ai ü to be true for the other meas pm 
Speeq) gj Pion of tests 1 p-Tempo ( e 
Cacti, -Suggestibility to 
their an Time ê these three tests malt 
rectionality on each criterion atis 
ima? З b-Tempo was a measure 9 the Sar io 
time ur Ога! work pattern asi дане 
tasks a to complete pa r ticular tas Mee 
пес е Wed psycho-motor ability in nu 
ырь ° Sorting, and dexteri 
a fac The candidates wereno оше 
"mI tor and were instructed n О ошап АР 


Pace. The teacher cane 


Factor XIII 


Positive Integration vs. Immature Ch 
"55 аг. x 
8a Willingness to Modify e 


Factor IX 
Adventurous Cyclothymia vs. Withdraw r 
thymia n Schizo- 
9a Reaction Time 


Factor X 


Neurasthenia vs. Vigorous Character 
10 b Perseveration 


most able on these three criteria us " 
in completing the tasks. ed less time 

Test 3 p-Suggestibility to Authority measured 
the shift of a candidate's reaction to fifty contro- 
versial statements. Three weeks after the candi- 
dates recorded their reactions to the statements 
they were again presented. On this second keit 
ing, the source of each statement was given. The 
index was the amount of change to the vi e w point 
of the authority by the candidates. Although the 
average of the amount of change on all criteria 
indicated that the best candidates shifted their o- 
pinion to а greater extent, the range of the two 
groups was not discrete. 

Test 9 a-Reaction Time was a measure of the 
elapsed time between the presenting of a visual 
stimulus and the candidate’s reaction of depres- 
sing a key- The superior candidates appear to be 
consistently quicker on this measure. 


Conclusion 
onc 


tations by Schwartz of Cattell’s tests 
of primary source traits do not generally appear 
to be helpful in the selection of candidates on 
these particular criteria. Of the three measures 
which were consistent in maintaining their direc- 
tion, only Tempo and Reaction Time are discrete 
enough to warrant consideration. 

Although using the total score on the Humor 
Judgment test did not seem to be of value in the 
selection of teachers by this analysis, Schwartz 
found a positive correlation between clusters of 
the items and the criteria. He concludes that “a 
sense of humor does have a sig nificant relation- 
ship to success the teaching profession. " (8, p, 


102) tative factors in the assessment of 


Two quali 
teacher effectiveness hypotheses appear to receive 


The adap 


86 JOURNAL OF EXPERIMENTAL EDUCATION 


some support from three items in this analysis. 
They are: 


Physical Attributes Personal Acceptability 


Tempo (Natural Speed) Humor 
Reaction Time 


It can be added that the results of the total battery 
of tests indicated that a modal or “colorless” 
personality was seldom selected as a promising 
prospect for the teaching profession. 


Application of Findings 
2ррлсапоп of Findings 


This analysis was initiated with a non-additive 
hypothesis concerning the assessment of teacher 
effectiveness. Many correlational approaches to 
this problem have combinedthe various compo- 
nents which appeared to be significantto superior 
teaching with negligible results. We have hypo- 
thesized that there are a limited few non-over- 
lapping critical qualities and that each quality is 
essential Therefore, a good teacher possesses 
at least one superior characteristic and does not 
fall below average on any quality deemed neces- 
Sary. Ateacher may be above average on oneor 
any number of characteristics, but if one compo- 
nent is missing or below aver age, the teacher 
will be ineffective. 

Five qualitative components were presented 
for testing by a directional pattern method. Mea- 
sures which appear to be in agreement with all 
the various criteria were assigned under one of 
these components. Althoughthe items under each 
quality did not appear to be Significantly corre- 
lated with items under other com ponents, they 
tended to be strongly related to each other. Sev- 


enteen tests and ratings were found to meet the 
requirements and are as follows: 


Academic Aptitude Motivation 


Total Grade Point 
Major Field Grade Point 
High School Rank 


Percent of Total Ex- 
penses 


Work Habits 
Participation in Ex- 


tra Curricular Ac- 
tivities 


Professional Adequacy 
IU NEE 


Professional Judgment 
Supervisor's Practice 
Teaching Rating 
Instructor's Practice Energy Rating 
Teaching Rating Health Self- Apprai 
h i 
Professional Education Perasa 


d Tempo 
Grade Point Reaction Time 


Physical Attributes 
ee utes 


Personal Acceptability 


General FirstImpression 
Initiative 
Humor 


If each of a group of teacher candidates pisa 
evaluated on the items inthis presentation a 
were available to the rater, a pattern c me ES 
predicted success could then be gons en us 
as hypothesized. For example, Teacher a dx 
and Teacher 4 (-) from the first two sets Nen 
bles would be represented according to meni t 
at the top of the next page. Teacher 38 ire К 
evaluated as possessing strong eee rr 
becoming a very effective teacher, W h ‘rare 
Teacher 4 would be viewed as a possible fat sary 

It is recognized that neither all the neces this 
qualities nor measures may be inc luded Mn 
analysis due to the limitations of the or AE rali 
measurement instruments and the compara the 
small samples employed. Yet, the m: this 
original investigations, when evaluate itive 
manner, do tend to indicate that a дола снет 
approach is helpful in the prediction of te 
effectiveness. = 

The hypothesis can only be further aor 
tiated or refuted with the use of a much ran? 
sample. It would be necessary to ole Ee 
objective and Subjective measures prior rush 
during actual professional teaching to cons pe 
with Some assurity, a model of discrete con sah 
lations or components of teac her effective 
It appears to be possible to develop a limite T 
qualities which represent all the neces sary at" 
ements of effectiveness. Theanalysis of the pe 
terns developed in these examples gives hope aii 
a pursuit of this nature will be more rewar 
than many previous attempts. 
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CHAPTER VIII 


THE ABILITIES AND PATTERNS OF BEHAVIORS OF GOOD AND POOR TEACHERS 


ARCHIE L. PERONTO 


As has been previously pointed out, evalua- 
tion of teacher effectiveness may be made for 
many purposes such as, for example, certifica- 
tion, placement, employment, assignment, pro- 
motion, improvement in Service, and salary de- 
termination. In some instances fine distinctions 
need to be made relative to effectiveness and its 
Concomitants, and in other instances not. In hir- 
ing, firing, and salary commitments, only broad 
categories of effectiveness would Seem to be nec- 
essary. It is from this point of view that we shall 
approach the problem in this chapter. The dis- 
cussion to follow is based upon the assumption that 
if one were able to set up, with reasonable accu- 
racy, three broad categories of effectiveness such 
as superior, average, and inferior, certain ad- 
ministrative needs of schools might be adequate- 
ly met. 

The lack of agreement on what should be con- 
Sidered in teacher effectiveness Coupled with un- 
certainty about the criterion of effectiveness con- 
stitutes what amounts to aroadblock in teacher e- 
valuation. Confusion is apparent not only in the 
employment of various criteria but also in the ar- 
ray of labels which have bee 
characteristics 
fectiveness, 
broad categor 
nutiae might 
the approach 


group studied. 
In striving to discover what it is that deter- 
er will succeed or fail, re- 


Ching effective- 
rious batteries of 
hat profiles of the 
her might emerge 


measuring devices in the hope ti 
good teacher and the poor teac 
from the data. 


In this study itis hoped that b 


y Superimposing 
a number of studies one upon ano 


ther or compar- 


ing them it may be possible: 1) to а cim v 
patterns or clusters of characteristics tha 2 
pear to be associated with effective tegante, = 
2) to discover variations in the amounts of ipi 
Characteristics that appear to be associated WAT 
Success and failure. To this enda re-study Mim 
be made of the data from certain of the erii 
ascertain the extent to which good and poor teac 
ers may be differentiated. nai 
Using a composite rating derived peremit 
tice teaching grades, placement bureau ra „ай 
and the principal’s M-Blank rating, М APEA 
Jones (41) divided a group of teachers into ë 
and poor teachers. Her data, shown in Figur x E 
Seem to indicate that some characteristics hile 
common to good and poor teachers alike, se 0 
other characteristics appear to differentiate ps 
and poor teachers, It appears, for example, fer- 
the degree of emotional stability does not dif m 
entiate good and poor teachers. Good te achin 
however, seem to be characterized by a prefe o- 
ence for quickness of action and efficiency apt 
duction. They seem to be more flex pisi 
numerical abilities and in disposition. Signifie 
differences in academic ability are indicated. the 
good teachers in Jones’ study are superior 10 ub- 
poor teachers in intelligence, knowledge of p 
ject matter, and professional know ledge. n8" 
measured in Jones? Study the good teacher 15 з o 
what more sociable and dominant than the P a5" 
teacher. Correlation coefficients of the six йе i 
ures found significant at the 1% level are give 
Table I. lity 
Throughout these investigations persona’) to 
has been given much attention. In an effor tind 
avoid the weaknesses inherent in subjective ie 
of teacher personality qualities such as the dui 
known halo effect, low reliability, semantic ср“ 
culties, and profusion of terms, many rae + 
ers have devised paper and pencil tests to m 28 
ure personality traits. Cattell, for examples in 
developed the 16 P F personality test. Cer re 
qualities of good and poor teachers were comP ile 
on the basis of this scale by Lamke (46). whole 
Lamke concluded that Cattell’s test , as ae did: 
fails to identify good and poor teachers, n go 
however, find important differences betwee! ut^ 
and poor teachers in such source traits t 107 
gency versus desurgency, adventurous с ja 
thymia versus inherent withdrawn schizothy 
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TABLE I 


COEFFICIENTS OF CORRELATION OF SIX MEAS- 
URES OF TEACHER CHARACTERISTICS TO A 
COMPOSITE RATING CRITERION 


Professional GPA . 516 
Major Teaching Field GPA . 524 
Two-digit Numbers, Addition . 484 
Two-digit Numbers, Subtraction . 383 
Two-digit Numbers, Mixed (Flexibility) . 418 
General Activity Personality Trait . 461 


eee 


CRITERIA COMPARISON OF THE QUALITIES FOUND DISCRIMINATING 


TABLE II 


BETWEEN GOOD AND POOR TEACHERS 


Rating 


Pupil Change 


Test 


No. of 


Discriminating 


Scales 


Test 


Hartman Social Attitudes 
Wrightstone Civic Beliefs 
Bernreuter Bn 
Bernreuter Bd 


Hartman Social Information 


Stanford Ed. Aptitude T-A 
Stanford Ed. Aptitude T-R 


Washburn Soc. Adjustment 
Inventory 


Morris Trait Index I, 


5 of 5 
4of 5 
lof5 
1 of 5 


2 of 5 


50f5 


lof5 


5 of 5 


lof5 


Hartman Social Attitudes 
Wrightstone Civic Beliefs 
Bernreuter Bn 


Bernreuter Bd 


Hartman Social Information 


Yeager Attitude Toward 
Teaching 


Sims Socio-economic 
Status 


Level of 
Signif- 
icance 


10% 
10% 

5% 
20% 
20% 


20% 


20% 


www 
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E Sophistication versus rough simplicity. Dif- 
benc m inresponse patterns concerned with these 
du appear to indicate that various combinations 
personality traits are found in good teachers 
es in poor teachers. No single ideal type of 
eacher was identified. | 
zati Lamke felt that certain limited generali- 
ations might be possible on the basis of differ- 
eee certain portions of the response patterns 
ае леа with the traits identified above, PT O^ 
i es that the size of the sample and the unknown 
e idity of the measuring instrument were COD! 
"és Differences in response patterns on one 
Portion of the scale suggest that the good teachers 
in this study are unusually alert physically, men- 
ly, socially, and emotionally as indicated by 
Ve average tendencies to be adventurous, gre- 
tha ous, and frivolous, to be more interested bie 
tio Opposite sex, and to have above average emos 
mh responses and strong artistic or sentimental 
io Sts. The response patterns оп another pur 
ge n of the test are interpreted as indicating tha 
fu teachers appear to be more es 
Fon: placid, frank and quick than poor m 
Te Other portionof the response patterne e 
a, 2! that good teachers appear to be aboutaver = 
d tendencies toward being polished, Huan pe 
ar idious. Response patterns of poor ea n 
ine interpreted to indicate tendencies towar F^ 
Clumsy, easily pleased, and more attentive 


чы than good teachers. These 2PP© ar x x 
ities which might be associated with over 
i dy also appeare 


Ormi : 
to isa: The evidence inthis stu! ia 
а dicate that good teachers tend to be os 
: €ntional, dominant, talkative, and sub) 
@ nervous tension than poor Баир 
Lay The Personality traits chart te 
might’, Š top teachers appear to qu and mental 
health be associated with good physic [ар under- 
Stan and a liking for people. Itis 255 ight tend 
to be nut teachers with these qua" 
Quest ated as good. An impor ° 
cont On is whether these teacher traits act ment 
9 tien to the personal growthand develop 
j^ 
ў e= 
tion a, an effort to secure a more e teach 
ers с: the differentiation of good and 0 tesis de- 
Signeg Son (15) employed eig pup swell 25 
infor, q to measure non-infor ional 25 s in Ser 
Snth s ational growth in the social studie 
Tura] nd eighth grade pupils in one, criteria, 
Carlson OOS. As supplementa"? {ests of 
Sache, em d penci ived 
ele ploy od pas SIE aie den е 
tati Se rating scales. The pupil cpm 
oh о ears were finally combine bs compared 
А Perso od and poor teachers who 
ег а "ed qualities measure 
Wh, €ncil tests. а, по 
еп these criteria were PÎY og paper 
uality as measured by the шш 


t 


and pencil tests was found to differentiate good and 
poor teachers at or above the 20% level of signifi- 
cance except the Hartman Social Attitudes Test. 

Data relative to personality qualities found to 
discriminate by the rating criterion and the quali- 
ties found to discriminate by the pupil change cri- 
terion are shown in Table II. Qualities significant 
from the 5% to the 20% level are included in the 
pupil change column to the right. Qualities found 
discriminating in one or more rating scales, and 
the number of scales in which they discriminate, 
are included in the rating column to the left. (See 
Table IJ. ) 

If the level of significance and the ratio of the 
number of discriminating ratings tothe total num- 
ber of ratings are accepted, it is noted that of the 
eleven teacher measures included in Table I there 
is some agreement between the two criteria on five 
qualities and a lack of agreement on six qualities. 

When the pupil change criterion апаа compos- 
ite rating composed of the Michigan, Torgerson, 
and Almy-Sorenson teacher rating Scales are com- 
bined, good and poor teachers inthis study are 
differentiated by dominance, knowledge of mental 
hygiene, civic beliefs, social adjustment, s o cio- 
economic status, attitude toward teaching, social 
attitudes and information, and teaching ability con- 
trasted with research ability. 

The evidence from Carlson’s study seems t o 
support conclusions reached by other investigators 
that different criteria and differentversions of the 
same criterion measure different aspects of teach- 
ing effectiveness. Thus it seems likely that in the 
present stage of teacher measurement the use of 
several criteria each measuring different aspects 
of effectiveness, as in Carlson's study, will fur- 
nish different answers as to who are the good and 
who are the poor teachers. | 

In measur ing the qualities believed to differ- 
entiate good and poor teachers, Carlson, Jones, 
and Lamke all employed paper and pencil tests A 
different approach is employed in Barr’s (4) study 
of good and poor teachers. While a rating of teacher 
qualities was made in this study, the principal data 
gathering device employed was performance rec- 
ords of the classroom behaviors of good and poor 
s of the social studies. The Selection of the 
teachers studied was made on the 
visory ratings and the assumption 
in the larger school systems employing offi- 
cials are more critical in their Selection of teach- 

s and that the lower salaries of smaller systems 
act poorer teachers. 
attr d that good teachers as compared 


Barr foun 1 
ith poor teachers were more vigorous, more en- 
wi and happier, less attractive, more 


jastic 
мые н, stable, more pleasant, sympathetic, 
em! i possesseda better Speaking voice 
ed a keener sense of humor. , 
and disp yt derived from observed and recorded 
e behaviors show distinct group 


teacher classroom 
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TABLE III 


ELEMENTS OF STRENGTH FOUND IN THE PERFORMANCE 
OF 47 GOOD AND 47 POOR TEACHERS 


No. of Teachers 
Teacher Behavior or Quality Inferred 


from Behavior 


Poor Good 


Interest in Pupil Response 5 38 
Use of Illustrative Materials 0 36 
Knowledge of Subject Matter 7 35 
Well-developed Assignments 0 32 
Good Notebooks and Outside Reading 1 31 
Conversational Manner 7 25 
Wealth of Commentory Remarks 5 22 
Frequent Use of Pupil’s Experience 4 24 
Good Technique of Asking Questions 0 21 
Ability to Stimulate Interest 0 20 
Socialization of Class Work 1 16 
Supervised Study 1 11 
Willingness to Experiment 0 10 


e _ 
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TABLE IV 


ELEMENTS OF WEAKNESS FOUND IN THE PERFORMANCE 
OF 47 GOOD AND 47 POOR TEACHERS 


سے 
No. of Teachers‏ 


Teacher Behavior or Quality Inferred 
from Behavior 


No Provision for Individual Differences 46 28 
No Socialization 43 00 
Textbook Teaching 40 16 
Inability to Stimulate Interest 39 0 
Weak Discipline 17 0 
Lack of Evidence of Preparation 13 0 
Lack of Interest in Work 8 0 

6 0 


Inadequate Knowledge of Subject Matter 
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differences in performance. 
E ee good than poor teachers appeared to be 
not only highly motivated themselves but also A 
peared to have more highly motivated pupils. 
Discipline appeared to be more or less ofa prob- 
lem in the classrooms of a majority of the poor 
teachers whereas no disciplinary situations were 
observed in the classrooms of the good teachers. 
Good teachers askedfewer fact questions and more 
thought questions than poor teachers. 

While Barr found insufficient provision for 
individual differences in pupils by both good and 
poor teachers, this weakness was almost univer- 
Sal among the poor teachers. Although peer-ap- 
praisal of pupil response wasrather infrequent 
in both groups, a tendency toward cooperative ap- 
praisal was evidentinabouthalf of the classrooms 
of the good teachers and almost completelyab- 
Sent in the classrooms of poor teachers. 

A number of behaviors was found to be com- 
mon to good and poor teachers. Very little dif- 
ference was observed in the teacher-pupil ratio 
of recitation time consumed апа in the length of 
teacher questions and pupil responses. Barr 
found both good and poor teachers tending to dom- 
inate classroom communication, 

Judgments of specific teacher behaviors as 
being good or bad are made on the assumption that 
all teacher behaviors stimulate pupil learning of 
some kind. Teacher behaviors whichare believed 
to promote desirable learning by pupils are con- 
Sidered to be evidence of teacher strengths, and 

those teacher behaviors which are b elieved to 
foster undesirable pupil learning are classifiedas 
teacher weaknesses. The quality of the learning 
experience is believed to be the only valid crite- 
rion of the effectiveness of the teacher. In the 

Barr investigation desirable pupil learning is in- 
ferred from observable pupil and teacher behav- 
iors; objective measurements of pupilgrowth were 
not made. Comparison of Barr's findings with 
evidence from a similar type of study in which a 
pupil growth criterion is employed will provide 


Some basis for evaluating the validity of Barr's 
evidence. 


Jayne's study (37) 
tions reported in the li 
classroom behaviors a 
pupil gain criterion. 
class recitation respo 


(See Table III and 


is one of the few investiga- 
terature in which recorded 
re Studied in relation to a 
In Jayne’s Study, since 


nses were tape-recorded, 
the data are restricted to oral interaction and 


subjects are not separate d into good and poor 
teachers. There аге two Studies: inhis first Study 
long-term gains and understanding were meas- 


ured, whileinthe second Study the teaching objec - 
tive was short-term gains, chiefly recall of fac - 
tual material. 


Jayne concluded that the r 
pupil talk had little relatio 
information. 


atio of teacher- 
nship to pupil gain in 


is no 
Jayne's data appear to indicate that E rand fiti 
difference in the relative value of thoug sais con® 
questions as far as pupil gain as — loyed by 
cerned. It may be that pupiltests en ability: 
Jayne did not measure problems uestions 
Jayne also found that the number of fac pes d to 
asked by the teacher is only slightly d cd recall, 
long-term gains as measured and to de 2 in his 
but significantly related to immediate re betweeñ 
second investigation. He found no relation d long” 
the number of thought questions asked a at i 
term gains or delayed pm Be found a 
lationship to immediate recall. | es, 
In repara to the appraisal of pupil wee ar 
when long-term gains in understanding qe raise 
Sized, Jayne found the number of questio ers to be 
concerning the correctness of pupil answ lated to 
highly related to long-term gain but ation was 
short-term gain as measured. No rela of mis” 
found between the number of corrections d rec 
Statements and long-term gains enl was 
but a significant relation to immediate re 
found. ; d to 
While Barr's good teachers were ngu r 
possess better speaking voices than hi between 
teachers, Jayne found no relation mediate 
the teacher’s speech ability and either ne secon 
or delayed recall of factual material inhi 
study. Index of 
In Jayne’s long-term gain study an that por" 
Meaningful Discussion was derived from f dis” 
tion of the data relating to the amount ОЁ gri” 
cussion growing out of pupil interests an clarifi” 
ences, bringing in additional information, i to 
cation of ideas, and the challenging of p 8 pe” 
Support their opinions with evidence. T able ip 
haviors appear to be reasonably comp ac py Bart 
purpose to the following behaviors reporte d роо? 
which were found to differentiate g oo d Rc о 
teachers: use of illustrative materials, be p 
commentory remarks by the teacher, use upil ^, 
experiences, and the ability to stimulate Pigh 95 ^ 
terest. Jayne found teachers who scored ‘e E 
the Index of Meaningful Discussion to be aini em 
Successful in promoting pupil long-term 8% mot 
first study and the least successful in PT ctu? 
Short-term gain or the rapid learning O et’ 
material, وا‎ Oh © сей 
The employment of different criteri н ао 
tiveness inthe studies by Barr and Jayn? icts ee 
evidence which in some instances contra ther De 
clusions drawn in the other study and іп ition, 2^ 
Stances supports the conclusions. In 2 cont. 
evidence in one of Jayne's studies tends many, 1% 
dict the evidence in the other study. In пе’ of 
Stances the conclusions derived from my те, j 
Study support at least to some extent jectiv t^ 
Barr's conclusions. In this case the obj elat? 00% 
the two situations may be assumed to Р 7837 рій 
Pupil growth in understanding, wherea те? 
Second study in which the objective wa: 
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"u ema of factual information, teacher behav- 
Standi ieved to promote pupil growth in under - 
EE аны to be either not related or else 
It ap vely related to the immediate recall of facts. 
ior pe that whether a specific teacher behav- 
tent u good or poor teaching depends to some ex- 
e Bei Objectives and upon the context in which 
avior occurs. 
Шы completes the summarization of inves- 
Special of good and poor teachers chosen for 
aS ma review here. None of these investigators 
or beh Dped the entire terrain of teacher qualities 
evic aviors. Hypotheses, data - gathering 
Stud We criteria and conclusions vary from one 
teristic another. In some instances the charac- 
While C^ measured in these investigations overlap 
ap. wee instances there is little or no over- 
these st ile in superimposing the data obtained in 
Contra, ee oneuponanother, perfectly clear 
ot em ing profiles of good and poor teachers do 
Of the a it is possible thatsome clarification 
Sood ifferences between and likenesses among 
Com and poor teachers may result from such 
Studies Sons, The overlapping areas inthese 
1) es of good and poor teachers proadly include: 
t che ledges, 2) interest and proficiency in 
tional T-pupil relationships, 3) physicaland emo- 
ity, вуепегву, 4) emotional stability, 5) flexibil- 
tivatio 9minance, and 7) professiona 1 mo- 
stances Evidence from other studies, in some 1n- 
tion st Will be examined for possible clarifica- 
the data already discussed. 

b eei. training institutions generally 
Poor i that knowledge differentiates £00 d and 
Know) chers. Differences of opinion concerning 
Ress h dge as a prerequisite to teacher effective” 

ave arisen chiefly from conflicts of opinion 


“Bories € relative importance of the several cat- 
pt Of knowledge, as for example, knowledge 
] knowledge, and 


Sub; 
knowlege matter, professiona 
Se of mental hygiene. 


I : Š 
Oun ce Jones’ investigation good teachers were 
Bence 0 be superior to poor teachers in intelli- 

tter, and profes- 


Siopa? ПОМ] š 
ha edge of subject ma 

trite ia 9 Wledge as measured by the tests and 
che, MPloyed. Thirty-five of Barr 


nave of auste rated as possessing adequate kai 
= Дег i ly seven 0: 
ч m. | rofes sional 


knowig асһегѕ were so rated. If p 1 
iors pa May be inferredfrom such teacher = 
Tem, Oped he use of illustrative materials, we 
marks assignments, wealth of com mentory 
to ер? frequent use if pupilexperiences, abil- 
roulat e interest, socialization of class 
Stra; i ion for individual differences, e 
igh, t On of Subject matter in ways other © 
à €xtbook organization, Barr's ood teac : 
appear to possess more PT ofe ssional 
han his poor teachers. Carlson ps 
ers somewhat above the average in thet 
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knowledge of mental hygiene as measured by the 
Torgerson Teacher-Pupil Relationships Test. If 
absence of discipline problems, provision for in- 
dividual differences, and opportunities for the ex- 
pression of pupil interests inclassroom activities 
are accepted as evidence of the implementation of 
the teacher's knowledge of pupils, Barr's evi- 
dence would appear to indicate that knowledge of 
these matters discriminates between the good and 
poor teachers in his study. 

What evidence there is inthese studies seems 
to indicate that professional knowledge, knowledge 
of subject matter, and knowledge of mental hygiene 
are discriminating characteristics. There is no 
evidence to the contrary. There issome evidence 
that the generalization does not apply to all indi- 
vidual cases and only to the means of groups of 
good and poor teachers. There is no evidence in 
these studies to justify any conclusions concerning 
the relative importance of the various categories 


of knowledge. 

It is commonly assumed that there is a dif- 
ference between good and poor teachers in interest 
and proficiency in teacher-pupil relationships. AS 
used in this context, this characteristic includes 
the ability to score high on paper and pencil tests 
purporting to measure social adjustment and s o - 
ciability, classroom behaviors which appear to be 
motivated by a liking for people, and high ration 
on qualities commonly associated with the ability 
to establish and maintain friendly relations wi th 


others. 
Differences in responses between good and 
poor teachers on the Guilford-Zimmerman Tem- 
t Survey in Jones’ study, shown in Table 
ts that good teachers tend to be somewhat 
able than poor teachers. When pupil 
gain and rating criterion are combined, Carlson 
found good teachers scoring above the group aver- 
age on the Washburn Social AdjustmentInventory. 
With ratings aS the criterion, the ev idence in 
Carlson’s study shows social adjustment scor es 
discriminating between good and poor teachers in 
all five rating scales. In Lamke’s study the re- 
ns on portions of Cattell’s 16 PF 


nse patter s 
spona rity Inventory are interpreted as suggest- 
ing that good teachers tend to be more gregarious, 


i i interested in the 
tive, and frivolous and more in 
ere ‘sex. Barr judged the good teachers in 
his study to be more sympathetic, pleasant, and 

erasthey worked with their 


reciative, happi 
Rm to possess a keener sense of humor, and 


to appear more interested in pupil responses than 


‚ teachers. 

e Ps Carlson's study in which both ratings and 
pupil gain criteria are employed, the Washburn 
test did not discriminate between good and poor 
gain criterion but in other 


with a pupil ite: 
ка it тав found to discriminate. When pupil 
gain criteria were employed instudies by Rostker 


more soci 
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(66), Johnson (39), Gotham (30), Rolfe (65), and 
Lyon (50), although all correlations are positive, 
no Statistically significant correlations of criteria 
to the various measures of social adjustment 
or social intelligence employed were obtained. 
These results stand in rather sharp contrast to 
correlations obtained in investigations employing 
a rating criterion. 

The difference in results obtained with differ- 
ent criteria account for many of the conflicting 
findings, Although it may not seem logical, itis 
possible that the strict disciplinarian who may ap- 
pear not to be concerned about human relationships 
may secure the gains on tests such as have been 
used to measure pupil growth and achievement. 
The halo effect may operate to produce an apparent 
relationship but not a true relationship between 
the rated effectiveness of the teacher and meas - 
ures of social characteristics. Paper and pencil 
tests devised to measure the social and personal 
Prerequisites to teacher effectiveness may not do 
So. Concerning the Pupil gain criterion most in- 
vestigators agree that the available devices meas- 
ure only certain aspects of pupil growth and de- 
velopment. While most attempt to do something 
with attitudes, the measuring devices are gener- 
ally quite inadequate. No measures attempted to 
to measure personality growth and development. 

The conclusions relative to the teacher’s in- 
terest and proficiency in teacher-pupil relation- 
ship as a determining factor in teacher effective- 
ness appear to depend upon the criterion. When 
pupil change is the criterion, the relationship is 
not significant; when rating is the criterion, there 
appears to be a relationship. 

Physical and emotional energy is a third fac- 
tor identified in the studies of good and poor teach- 
ers as a possible differentiating characteri stic. 
Lamke and Jones found good teachers’ responses 
on temperament tests indicating quickness of ac- 
tion and efficiency in production. Lamke found 
good teachers to be above average in emo tional 
response. teachers as being 


ly in agreement. 
ers possessing more Speedi 


nperforming psycho- 
motor tasks. Schwartz ( agi 


72) found reaction time 
negatively related to criterion. Erickson (24) ob- 


tainedlow correlations of criterion to scores on 
the active and vigorous response portions of the 
Thurstone Temperament Schedule. The Weight of 
evidence in the studies examined appears to sup- 
port the conclusion that physical and emotional 
energy is to some degree a differentiating char- 

acteristic of good and poor teachers, 

Measures of qualities which appear to be re- 
lated to emotional stability were employed in all 
the studies of good and poor teachers included in 
this discussion. Lamke's data Suggest that good 


Stic than poor teachers, 


teachers are more placidand cheerful and mud 
to more nervous tension than poor teac В m 
Emotional stability as measured by the Bernre їй 
test appears to discriminate somewhat peer 
Carlson’s study when pupil gain is the cr ү is 
than when rating is the criterion, although i 
difficult to be certain as to what this ше the 
the twenty teacher measures employed Е ару а 
Jones’ study, emotional stability as measure er- 
Sub-test of the Guilford-Zimmerman Tem P ойе 
ament Survey is least related to her yao @ 
rating criterion. Barr noted a greater Ho gle 
self-control in good teachers than in poor tainly 
ers. The evidence in these studies is te dit" 
inconclusive and probably somewhatcontr 
tory. 
ыба (30), Rostker (66), Rolfe ( 65 de 
Hellfritzsch (34), on the other handare in ji the 
ment that emotional stability as measured thei 
Bernreuter test is not significantly canes ioni 
pupil gain criterion. To add further cor 6) re” 
summary of investigations by Barr et a rela" 
ports that 33 investigators found a positi iter i0 
tionship between emotional stability and iem cot" 
Thirteen zero correlations and no negati nile 
relations are reported in this summary. š 
there is no lack of evidence to support thi 
of view there is a lack of evidence that is = 
sive enough to generalize with assurance lity 85 
discriminating power of emotional stabi inves” 
measured by the devices employed in these E 
tigations. inan 
The evidence in the literature on ДЫП көле $ 
as a discrimination factor inteacher pue amo on 
is possibly more inconclusive than the perd m^ 
emotional stability. Carlson concluded | st ай” 
inance as measured by the Bernreuter Ad ne? 
ferentiates between good and poor teacher nante 
rating and pupil gain are combined. DO and ®) 
discriminated in one of five rating scales go? 
the 20% level to pupil gain. Jones fou n cured by 
teachers somewhat more dominant as теа m "A 
the Bernreuter test than poor teachers. easure 
found good teachers more dominant aS = à 
by the Cattell inventory than poor bm š any 
In studies by Gotham, Rostker, Ro ositive Я 
Hellfritzsch dominance appeared to bie P^ ag P 
but not significantly related to pupil ga T twenty, 
Summary of investigations by Barr, et. Jp dom 
four investigations are reported in w wm cr“ 
nance was found to be positively related v an 
rion, nine in which the —— was Z š 
none reporting negative correlations. of 
The megs ет appears to supp sib! 
conclusion that dominance as measuredis P I 
a minor discriminating quality. EM is co^, 
Flexibility as contrasted with rigidity" teal, 
monly believed to be a desirable quality 1 a mo, 
ers. Jones found good teachers possessing $ 0 
flexible disposition as measured by the o? 
Zimmerman paper and pencil tests tha 


and 


^ 
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teacher 
бге appear Баага gata SUELEN that good teach- 
tional than o be more adventurous and unconven- 
appear to al teachers. These qualities would 
ierste] suggestive of flexible disposition. 
Poor teac} inthe recorded behaviors of good and 
teachers AES led Barr to conclude that good 
teachers a more willing to experiment than poor 
he same di he evidence in these studies points in 
ere may оп and seems to suggest that 
god ana pon ne difference in flexibility between 
Pear to са teachers, although it does notap- 

In the a critical factor. 

has been f past two decades considerable effort 
Of motiv agg upon the study and measurement 
"here m Since this topic is discussed else- 
imited to the evidel the discussion here will be 
good and e evidence in the investigations 
OWard te poor teachers. Carlson foundattitude 
aching as measured by the Yeager teach- 


er att; 

Pupil m test to be a discriminating quality when 

th n alone was employed as a criterion, а 
hen rating and 


pupi A level of confidence, and W 
‘One ани combined but not when rating а- 
‘ors of t he criterion, Carefully recorded behav- 
Provide eachers over a period of time may well 
motivati valid a measurement 0f professional 
Purporting as available paper and pencil tests 
terest s to measure this characteristic. If in- 
Cher b eaching may be infe rred from such 
Чзе of ill ehaviors as interest inpupil response, 
Pupil int ustrative materials, ability to stimulate 
degree oe amount of daily preparation, and 
Pears t enthusiasm displayed, Barr’s evidence 
О suggest that good teachers display 


More É 
h 
ighly motivated behavior 


ers than poor teach” 


evidence from 
teachers has been 
some instances 
other stu dies. 
erlap in varying 


In 

Certain st foregoing discussion 
с Marj udies of good and poor 
Speman y o mpaned, and in 
deren qu nted by evidence from 
Sees alities were found to ov! 

Зада ы еве studies: 1) knowledge, 2) inter- 
id att; lj ciency in teacher -pupil relationship? 
6 nergy a problems, 3) physicaland emotion- 
) dom 4) emotional stability, 5) flexibility, 
ance, and 7) professional motivation. 


he ev; = 
ia he idence in these studies seems to sup 
Ше е measuruble 


€ Conclusi 
: ion that there ar l 

Certa CES between Е and poor teachers in 
little difference 

aracteristics 
о be con” 


th ; 

nes ality Some instances a higher dogres eid 
e evid З à 

e tha, CVidence is not cone 
qup ta a is available in these studies iS needed 
lities 5h а firm relation betwee? some of the 
je aSured and teacher effective ness 
whi m of identifying patterns of character- 
d poor teachers 


elu 
h differentiate good an 
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is compounded by many thi i 
those arising tiam cé ew p hd nieder s 
quate criteria anddifferent measuring ees inade- 
may or may not be reliable. How аан tiat 
ferences affect the importance of these aa que 
is a problem for future research. a 
The evidence presented seems 
thought that academic and Rok ER arts be 
are important qualities differentiating go ye En 
poor teachers. Epod aug 
The difference between good and T 
in interest and proficiency in mei cura! us 
tionships is found to vary w ith thecriter o x 
When rating is the criterionthe responses of em 
teachers as measured in these studies reels: 
indicate that they possess greaterinterest nis 
proficiency in teacher-pupil relatio n $ hips than 
poor teachers. The evidence from other studies 
employing pupil gain as the criterion seems to 
support the conclusion that interest and pro- 
ficiency in teacher-pupil relationships is not a 
differentiating characteristic. Since the two cri- 
teria apparently do not measure the same educa- 
tional objectives the evidence suggests that con- 
cern over teacher-pupil re lationships is not 
related to pupil growth in academic achievement 
but may be related to the pupil's personal growth 
which is not measured in these investigations. The 
y be true is difficult toas- 


degree to which this ma 
sess on the basis of available evidence. 


Although the evidence is not conclusive, the 
weight of the evidence indicates thatthere is some 
reason to believe that physical and emotional en- 
ergy differentiates to some extent between good 
and poor teachers. It may be that a certain min- 
imal degree of this quality is essential to teacher 
effectiveness but excessive amounts may become 


detrimental. 

While emotional stability would seem logically 
to be a prerequisite to teacher effectiveness, the 
evidence here examined based upon the tests used 
indicates that different investigators get different 

lation toa moderate re- 


results varying from nore 
lation. It is recognized that available paper and 


encil tests which purport to measure emotional 
stability are inadequate. There is also aselective 
factor. Few extremely unstable teachers enter or 
eaching profession. The dif- 


remain long in the t 
ferences in the people that enter teaching are not 
great enough in this respect to become in тапу in- 


stances 2 critical factor. It seems likely that a 
certain amount of emotional stability is essential 
to successful teaching. 
The evidence concerning dominance as a dis~ 
minating factor in teacher effectiveness pre - 
e same picture as has been 
noted above in regard to emotional stability and 
physical and emotional energy. It is likely that 
few cases at either extremeare represented in the 
teacher populations studied. It seems likely, too, 
that it would be the extreme cases which might be 


cri 
sents very much th 
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associated with ineffective teaching and the me- 
dium range most likely to be related to effective 
teaching. The differences within the medium 
range are difficult to measure accurately with a- 
vailable measuring devices. The weight of evi- 
dence, however, seems to indicate that good 
teachers are as dominant or slightly more domi- 
nant than poor teachers, but dominance as meas- 
ured in these studies appears not to discriminate 
highly between good and poor teachers. 

The evidence on the discriminating power of 
flexibility and of professional motivation indicates 
a positive relation to effective teaching but again 
the evidence is insufficient to provide a basis for 
making a firm generalization about this. Some 
minimal degree of flexibility would seem to be es- 
Sential. Motivation has often proven to be an in- 
tervening variable between ability and achieve- 


ment. Establishment of the relationbetween these 
qualities and teacher effectiveness, as with cer- 
tain other characteristics considered in this dis- 
cussion, appears to be a problem of measurement. 

Of the characteristics believed to diff eren- 
tiate good and poor teachers, only knowledge of 
subject matter and pupils and professional know” 
ledge appear to be definitely established as dis~ 
criminating between good and poor teachers. In” 
terest and proficiency in teacher-pupil relation” 
ships appears to be related to the personal growth 
of pupils but unrelated to academic achievement. 
Good teachers seem to possess some minimal de- 
gree of physical and emotional energy, emotional 
stability, dominance, and flexibility. The evidence 
in these studies of good and poor teachers on pro- 
fessional motivation is too limited to warran 
drawing conclusions. 
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CHAPTER IX 


THE PERSONAL PREREQUISI 


TES TO TEACHER EFFECTIVENESS 


A. S. BARR 


Beginn; 
e s йр with the first teacher rating scale 
Prerequisites | continued interest in the personal 
еге has e to teacher effectiveness. While 
Erowing a epe during the last half century, à 
Mon ime, persistent interest in the psychology 
omen. in individual differences, and inchild 
Ponsibilitio: relation to the teacher's classroom 
loe ip terme 5а е description of teacher behav- 
tinued, Ads of personal characteristics has Соп” 
these o ccordingly, one finds in literature today 
teacher eee established systems of describing 
teacher Нацева, namely, one that describes 
о eQuisi ectiveness in terms of the personal 
&Ctivene ites, and one that describes teacher ef- 
tencieg, > in terms of professional compe- 
Iti 
рош “ү purpose of this chap 
Perso al e approaches made to à 
What есы requisites to teacher effectiveness In 
hat sue ertions here summarized, Ai with 
E eee As in the other papers inthis mon? 
Wil P nal i of the researches relating to the 
he M Rien ee и teacher effectiveness 
i of the idered but, rather, acertain selected 
i rom omes that seem to illustrate depar- 
Set, е commonplace in some importantre- 


ther 


dey, 
Tes 


ter to consider 
the study of the 


With re оп 
e 
fercher сые to the personal pre 
à Sorts i Sness one finds first o 
ring q of tests, rating scales, and other data 
eS the ieee have been employed: Some" 
€achers were interviewed, sometimes 


Que, , "ed 

vay tions + Work, and sometimes asked to answer 

Чез bout their own behavior, attitudes, and 
of devices 


ме SS. j 
ir Ah all a very great varie 
us, Barp 769. 
°nly three Torgerson, and others, for example, 
teag he pe of personal characteris ee th 
to Cher рдү SOnality rating scale except that tae 
ing scales all contained items oe cial 
my nee itness, The three tests were SO 
Wag e, С Test, F. A. Moss, T 
x p Mato ^ Mer for Psychologie? аң 
ne: H. m D. C., 1930; The Morris ing Com- 
Beat: Big Моггіз, Public School Publishing ona 
TPA Sta, ington, Illinois, 1930, and Pere au 
"унбер рака and Scal T. D. Wood, a 
"sity. us Teachers College, Columbia La 
W York, 1925. The perso" 


€ examines the studies here summarized 
requisites to 


f all that dif- 


scale was an informal ten-point scale based upon 
thirty-three personality traits taken from the 
Charter-Waples Commonwealth Teacher Training 
Study, and other sources. The correlations with 
the various criteria are shown in Table I. 

None of the measures, except possibly social 
intelligence with an over-all composite criterion, 
and the personality rating, Was statistically sig- 
nificant. The latter correlation was probably due 
to halo effect and the former probably due to some 
sort of generalized verbalaptitude. From data 
presented in the report of this study the three cri- 
teria employed in the study appeared to measure 
different things. 

Gotham (30) attempted a systematic study of 
personality and teacher effectiveness, employing 
two types of personality measures, namely, tests 
and rating scales. Three criteria were employed: 
a) supervisory ratings, b) tests.of qualities thought 
to be associated with teacher effectivensss, andc) 
residual pupil gain. Three standardized tests, 
three widely used teacher rating scales,and two 
unstandardized personality ratings were employed 
to measure the personality characteristics of the 

hown in Table II. 


teachers with results as S 
The high correlations (r=. 87) between the two 
unstandardized personality scales and the criterion 


of teacher rating scales are probably due to halo 
effect. The intercorrelations am on gthecriteria 
were Mpc 13; Гас 40; тар=. 25. Theonly testthat 
seemed to offer promise was the Washburne Social 
Adjustment Scale. The low correlations may be 
traceable in part to errors of measurement but 
probably mostly to the fact that the different 
criteria measure different aspects of teacher ef- 


tiveness. š 
Е Von Haden's (82) study differs from the other 
studies here summarized in thatthe chief data gath- 

interviews, autobiographies and 


ing device 
ering members of the department of educa- 


2 { Wisconsin. The previously discussed 
d tests and rating scales. The data 
ed with reference to eight 


: ness 
siderate or of values andwork habits. The 
„acteristics and the mea 
on these charac ; n of the 
scores ^^ red were correlated with three criteria 
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TABLE I 
Teacher Composite of 3 
Measures Pupil Rating АП. Messe 
Gain Scales 
Social Intelligence M .10 -31 
Morris Trait Index L -.11 . 08 1T 
Wood Health Scale .14 -.11 =; 11 
Personality Rating .30 .95 34 
*Ехсерї measure correlated 
TABLE II 
Criteria 
(a) (b) (c) 
A. Three Tests of Personality 
' Bernreuter Personality Inventory .01 «18 04 
to .19 to .19 to -.14 
2. Washburne Social Adjustment 
Inventory .40 . 47 . 06 
3. Rudisill Personality Scale .16 si .35 
to .30 
B. Three Teacher Rating Scales 
1; Michigan Teacher Rating Scale * .39 
2. Torgerson Diagnostic Teacher 
Rating Scale * .43 
3. Almy-Sorenson Rating Scale * 36 
C. Unstandardized Personality Scales 
1. А Four-point Personality Scale .87 .15 .30 
2. A Thirty-three Item Personality 
Scale 87 .14 . 35 


*The correlations between the ratin 


ally high but spurious due to the halo effect. 


g Scales and the 


Supervisory ratings were gener- 


E [Eber effectiveness, namely, a) a composite 
E wer ae ratings, b) a composite pupil 
those 2 and c) residual pupil gain. If only 
Cat al rrelations that were statistically signifi- 
were а the 1% ог 5% are considered, 45 
With the 1 the supervisory rating criterion, 12 
With the pupil evaluation criterion, and only one 
Sixteen рр gain criterion. Two hundred and 
Significa cn correlations were not statistically 
lations m The statistically significant corre- 
follows: r the several characteristics were as 
Work оя 11, professional judgment 9 
adaptabilit 8, energy 4, system of values 4, 
Gian 3, and considerateness 2. 
the use t. the unique features of this study Was 
Variables personal characteristics as intervening 
ehavior { b, the analysis goes from recorded 
е ла inferred personal characteristics, to 
data in l. ion. There would appear to be adequate 
at, as hese investigations to lead one to infer 
ata Pt ie as a behavioral approach is for 
Hog ee and defining teacher characteris- 
terms oe effectiveness cannot be defined in 
rom hs behaviors out of context, i. e. , divorced 
the ap Urposes, persons, and situations. When 
ёа j ene aspect of behaviors is dis- 
roach the correlations would appear to ap- 
в. 2его as a limit. 

5 ца (24) employed, among other meas" 
erived fan measures of personal characteristics 
е and from the Thurstone TemperamentSched- 
tell Sixteen беп measures derived from the Cat- 
Correlate Personality Factor Test. These were 
ation ed with supervisory ratings, self-evalu- 
Cor Š — evaluation, and pupil evaluation with 
i eee in Table Ш. 
OW coef Seldom that one finds mor 
ed, ficients of correlation than here re 
tistical with possibly one or two exceptions, Sta- 
T eing „Significant. Ш one accepts these tests 
ation, б adequately validated against other popu- 
posers, they have been extensively so used, 
ance "PSSibly we can give these teachers clear- 


a map Meaning that selective factors operated in 
that may fall 


r 


e consistently 
port- 


е š 
criti 
;CTitical areas for these tests- 
cial com pe^ 


tiveness. The 
easures are 
elations 


in Tab i intercorr 
le IV, while the 1n ee 


amo 
ffectiven' 


abl 
со. The e V. | 
метре enc) relations of the measures of social 

Ss are СУ With measures of teacher effective- 


‚‚ © Shown i 
Ch, Si Wn in Table VI. Г 
exacte, "Stead of investigating rt pers 
w ics, = in depth. 
Wit examined one in dP ations 


in 
h th eS the q 
igp S ata, particularly the СО 
e ts arb erVisory rating criterion, some new 
S°veral had as to the interrelationship among 
measures and this criterion- Allo 


1n 
the 


BARR isi 


the correlations are positive and probably А 
ЗР significant except the не й co bin рч 
OW well he is accepted by the students. While 
correlations are not high, they would appear to 
offer some promise for further investigation. 
А Schwartz’s (72) study is interesting because 
it represents a new approach to the prediction of 
teacher effectiveness. A comparison of this study 
with Gotham’s study reveals how markedly dif- 
ferent these two studies are and gives some 
evidence of advance in personality measurement 
in the decade that separated these two studies. 
Using Cattell’s grouping of personality traits as a 
point of departure, Schwartz constructed new tests 
or adopted Cattell tests for use with teachers. His 
tests cover jokes, tempo, absence of questionable 
preferences in reading, perceptual speed of clo- 
sure, inability to state logical assumptions, Sug- 
gestibility, cube perspective, ideomotor speed, 
ratio consonant/dissonant statements recalled, ra- 
tio purposeful to chance observation andmemory, 
two-hand coordination, immaturity of opinion, im- 
pairment of memory by emotion, reaction time, 
body sway, suggestibility and perseveration, with 
supervisory rating as the criterion, fairly sub- 
stantial correlations Were found for two hand c o - 
ordination (-. 60), reaction time (-. 53), temp jokes 
(-. 42) and perceptual speed of closure (-.38). А 
multiple correlation of . 74 was found for three 
ely, two hand correlations, reac- 
WashburneSocial Adjustment 
Inventory and the supervisory rating criterion 
to be an improvement over 
a prediction point of view. 
y was undertaken as a fol- 
low-up on Schwartz's (12) study. Using a compos- 
ite of four in-service ratings made at the end of 
the first year of teaching as composite one and 
these ratings plus an additional rating by the prin- 
cipal made at the end of the second year of teach- 
ing as composite two, aS the criterion, correla- 
tions were calculated between these criteria and 
a number of measures of temperament. The cal- 
ix of the obj ective measures and the 


culations for $ à 
two criteria are given in Table VII. 


iption of Tests: 


Description 0 -67> 


1. Speed of tapping ( 
on tapping instrument) was on 


ures of tempo. 


number of taps in 30seconds 
e of five meas- 


2. Deviation in reaction time (forty reactions in 
` es with irregularly spaced time 


a visual seri 

intervals) was one of four measures of speed. 
3. Fluency (number of adjectives todescr ibea 
f e of three measures of fluency. 


house) was On 


t hand coordination (difference 


isht and lef 
4. Righ age number of taps of right 


between the aver 
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TABLE III 


Measures of Teaching Success 


1 2 3 4 5 6 T $ 
Ma^ nie -—17 -.04 ..14 ..26 ..14 „15 -14 и 
Я. Vigorous 12. .19 -.08 -.03  .05  .24 ..09 .16 
3. Impulsive 18  .001 ..02 от  .15 16 ..07  .06 
4. Dominant .26 16 .06 .17  .09  .22 12 .08 
5. Stable 16 16  .08 0 .06 .20 .09 .04 
6. Sociable 023 .18 09 gy 12 .20 „т -.01 
T. Reflective 08 -.01 .20 о -.о1 03 16 90 
B. Cattell Measures 
1. Cyclothymia ^13 .00 .01 в e ов oB ..08 
2. Intelligence 12 -.90 -.21 „до у оз ов .от 
3. Emotional Stability .01 -.05 ..08 ов .03 -.05  .01 . 08 
4. Dominant 05 +05 ..04 ..04 ..06 20 05 13 
5. Surgency 0 .00 .03  .16 оо от -10 ..09 
6. Positive Character 10 .06 .26 .23 2 б 22 .21 
t. Adventurous 
Cyclothymia Cio 4ء‎ aii .08 aae в ói 07 
8. Emotional Sensitivity . 09 18 .07 -.06 11 . 06 . 06 17 
9. Paranoid Schizothymia ^. 06 10 -.01 -.15 оз оз . 9g ..05 
10. Bohemianism "M uH nii 18 one ы -.04 -.23 
11. Sophistication -.21 .04 1 --03 .12 93 18 .09 
12. Worrying 
Suspiciousness -.16 10 .00 15 12 „27 22" 17 
13. Radicalism ex i 14 07 -.21 08 ‚00 17 m 
14. Self-Sufficiency -.01 .01 210 و‎ 11 .00 -.02 .02 
15. Will Control *28  .20 gg 20  .28  .21 +38 20 
16. Nervous Tension 9 -18 | 03 _.95 .13 .13 2,99 ,10 


BARR 


. MMPI (Social Introversion) 


TABLE IV 
Rating 1 2 3 5 

. Teacher-Teacher Social Distance ms  -----  -----  ---- 
- Teacher-Student Social Distance pau ou 
- Student- Teacher Social Distance FEE" 22 ج‎ бәһанә 
- Social Competency Based upon Recordings 278 315 .354  -----  ----- 
- MMPI (Social Competence) -.385 -.282 -.477 -.503 ----- 

-.186 -.077 -.104  -.007  -.093 


1. Composite Supervisory Ratings 
2. Teacher Self-Evaluation 


3. Pupil Reaction to Instruction 


1079 ===== 
4.565 4.262 
4.524 +11 


+. 346 


4. Specialists Evaluation of Audio Recordings 


TABLE VI 


2 3 


4 


1 
.431 -. 088 .581 . 352 


Д, 
2. 
3. 
A 


Teacher- Teacher Social Distance (staff rating) 


Teacher-Student Social Distance 


Student- Teacher Social Distance 


Audio-Recordings Social Competency 
MMPI (Social Competency) 


MMPI (Social Introversion) 


4.150 .068 +.166 
4.702 .069 +. 750 
4.524 .171 .346 
-.567 -.255 -.464 


-.4m 4.76 -. 031 


.441 
.369 
-.519 


-.048 
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TABLE VII 
Composites 
Measure No. 1 No. 2 

Speed of Tapping .45* . 41 
Deviation of Reaction Time in a 

Positive Direction 51 „89 
Fluency (adjectives) .41 .28 
Right and Left Hand Coordination «57 . 47 
Maze Number 1 . 42 . 36 


*The signs have all been reflected since negative correlations indi- 


cated positive relationships. 


TABLE VIII 
Measure 1 2 8 4 
1. Speed of Tapping 
2. Reaction Time .15 
3. Fluency 19 .08 
4. Right-Left Hand Coordination „51 :37 .28 
5. Maze Number 1 . 95 „37 .28 .32 


and 1 
Ба hand) was опе of two measures of dex- 


9. M 
[e Number 1 (trace through a maze laidout 
edis ocks comparable to a city street system) 
one of three tests of disposition rigidity. 


are a intercorrelations among these measures 
quo a Table Vul- 
with Schwa findings are in substantial agreement 
What more rtz’s findings which makes them some- 
ated > interesting than the results from iso- 
ee 
iiber gn Jones (41) correlated scores on a 
Dosite rat; measures of temperament anda com- 
of dispositis, criterion. The scores on measures 
ity, restr ion rigidity, flexibility, general activ- 
relateq T ascendence, and sociability COT - 
Separated ee with a rating criterion а nd 
Number or y teachers from poor teachers. A 
forties "e correlations were in the thirties 
°y seem t The findings are significant because 
OSS and i o support those of Schwartz and Mont- 
may be indicate that temperament measurement 
effecti a fruitful field for predictors of teacher 
ру hess. 
Phas} lanagan (26) studied the Minnesota Multi 
ALY Inventory in relation to teach- 
e 3 ime He found that a high coding of 
each У), hysteria, was significantly related 
» Was f effectiveness, scale 5(Mf), masculini- 
ness for ound to be related to teacher effective- 
Scale both men and women but less firmly than 
p ations There also appeared to be an inverse 
to ake mm for 2(D), depression, for'wome?. 
N relate erprets low coding of Scale 2 for women 
Ms Only E. “socially out going characteristics. "' 
PUE bu a Flanagan study particular character- 
lso patterns of response. No meaning- 


:. Patter 
Qitterent nS were discovered except menpresented 
Ban Personality patterns than women. Flan- 
lprocesses of 


Co 
20Це ides that while the natura 
&uiga c 2nd the effects of testing, counseling, 
ity q Ce tend to eliminate the extreme,per- 
ality pe ate, the Minnesota Multiphasic Per- 
to, У Inventory has good possibilities as a рге” 
teacher effectiveness. The Minnesota 


exten- 
Place Stug has been 


ЕТ effec 


to 


. died with positive results. Society has 
of personality 


Y this scale. It deserv 
device and a clearance test. 


Su 
Um 
ar 
1, 2nd Observations 


Ma 
Derg, ferent words are used to descri : 
is , Pob Characteristics of teachers. One о 
S how ems confronting workers f. this area 
to reduce the list of descriptive terms 


l > 
"E to some meaningful pattern- 


Teen; 


овар 
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The problem of measuremen 

solved. While a variety of кз ci ag d 
vices were employed, such as tests, € iu 
scales, self reporting inventories, i nter- 
views, and direct observation of behavior 
none, except possibly the measurement of 
temperament and social competency, show ed 
much validity. Most of the correlations were 
near zero, depending upon the criteria. 


The different investigators and constructors 
of data gathering devices defined the charac- 
teristics differently, and in most instances 


chose to measure different aspects of person- 


ality even where similar vocabulary was em- 


ployed. A difference of particular concern 


arises out of the fact that some investigators 
appeared to think of these personal character- 
istics as constituents of the person, bika WS. , 
something within the person and others thought 


of the personal characteristic as external and 
inferred from a study of behavior, i.e., they 
employed the vocabulary to describe behavior. 
This would appear to be an important differ- 


ence. Some give to these personality char- 


acteristics the status of intervening variables 
owers; others used 


with action regulating p 
these terms to merely describe behavior. The 
latter would appear to the writer to have much 


greater promise than the former. 


erious problem of definition. The 
terms empl oyed in discuss ing the personal 
characteristics of teachers means many dif- 
ferent things to different people. No field needs, 
more than personality measurement, a mean- 
ingful system of definition, such as might be 
achieved through carefully constructed behav- 
ioral and/or operational definitions. 


There is S 


erms used to characterize the per- 
sonal prerequisites to teacher effectiveness 
need to be solidly anchored in observable be - 
havior, behaviors, even when taken in c o ntext, 
which frequently they are not, are too numer- 
ous to provide a useful system for describing 
teacher effectiveness. Without getting too 
many intervening variables, and variables that 
are too ethereal to be varifiable, there is need 
for simplified schemata of reducing the number 
of things that educators need to keep in mind in 
the evaluation of teacher effectiveness. 


While the t 


It has been frequently observed that different 
different aspects of teacher 


criteria measure 
effectiveness. Not too much can be achieved 
in the validation of personality measures until 
better criteria are developed. 
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Possibly less use might well be made of self 
reporting devices and the conventional point 
value rating scale, and more use might be made 
of tests, observable behaviors, and me asur- 
able personal characteristics. 


The most promising positive relationships 
were found for objective measures of emotion- 
al stability, social competency, certainscores 
on the Minnesota Multiphasic Personality In 
ventory and the tests of temperament. 
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CHAPTER X 


MOTIVATION OF TEACHERS AND TEACHING SUCCESS 


THOMAS A. RINGNESS 


es TE motivation influences his behavior 
ing im rough initiation, but through determin- 
Such cs irection, strength, and perseverance, is 
ic. ee psychologists that 
DA a a of some surprise to see how com- 
Predict: y few studies of teacher effectiveness or 
factor "a of teaching efficiency have taken this 
Sinon pe excepi possibly other than in 
сопан wee way. Motivation has been a special 
Psychol of personality theory builders, of social 
ists ant of clinicians, of personnel special- 
Say that educational psychologists. This is not to 
Vation no concern has been shown for the moti- 
Sie of teachers in the studies here summarized, 
Bet 01 see, but the concern is frequently 
Ча eral. Measures of teacher satisfactions 
аза e anges of reasons for choosing teaching 
mr of social and professional attitudes 
ter or uu matters appear to get lost in the wel- 
tivenes ings that may be related to teacher effec- 
that th S. Accordingly, it appears to the writer 
te sima problem ot clarifying this ar ea of study 
Boski basically unsolved. 
comple ibly the difficulties of working through the 
the wa. xities of motivation theory have stood in 
true th of effective research in this area. It is 
both n at the formulations of motivation theory are 
it 15 merous and somewhat controversial, and 
and 4, 59 true that we have found so many levels 
lated 25908 of behavior more ог less directly ге- 
the task human motivation that the complexity of 
May ha Of relating the many variables to practice 
The gj, discouraged many workers in this area. 
iculti y 
th Be that 2.68 are many and real. isa i 
in prays n it may, why one teaches rel? e: 
Su his Work, teaches, tothe за 
Sees ; and thus directly o 
ar nce mee Shall discuss first a Í 
еа to th then relate some of the 5 


15 frame of reference. 


Ar 
Ormular; 
"lation of Human Motivation 
itiating and 


My Uman " 
in enu motivation functions in ini апа is 
тп ehavior. Itaffects perception, an" v^» 
tion and out- 


" * affected by it. It adds direc 
Th 
refer to the number 


16 rer, 
ticu, Fence numbers used in this chapter 
Chapter, 


Thus whatever its course, motivation will 
cisions about which behaviors will 
als will be sought, how cer- 
tain events are perceived, how long behavior will 
continue, and the degree of satisfaction and conse- 
quent reinforcement of behavioral tendencies 
which result from responses in a situation. 

Shaffer and Shoben (34)* have briefly consider- 
ed some of the explanations of motivation. We 
shall mention a few. 


put. 
be a factor in de 
be employed, which go 


Postulations of Motivation 


ivating power was attributed 
to “instincts” (34: 25), so that a pugnatious per- 
son was thought to have an instinct to fight, the 
hard worker an instinct to,industriousness, and 
so on. Such instincts were thought to be born in 
one, and a person thus merely carried outhis na- 
tural tendencies. This sort of belief places people 
at the mercy of their genes, andr eally does not 
help solve motivational problems. In effect, all 
that is thus said is that someone fights because he 
has a tendency to fight— a descriptive rather than 


an explanatory statement. 
‘Another hypothesis has been that motivation is 


the result of some kind of inner energy or force, 
psychological in character, which initi ates and 
continues behavior. Psychoanalytic theory was 
pased on such hypotheses, as with Freud’s gener- 
al life instinct or Jung’s libido, “a broad drive 
supplying energy for all behavior” (34: 26). With 
Shaffer and Shoben, we would argue that the pos- 
tulation of a psychic energy as different from all 

oducing an unnecessary vari- 


bodily energy is intr! 
able "tor it can reasonably be held that so-called 
“intellectual” or “emotional” behavior is in ac- 


tuality pased upon neutral electro-chemical activ- 
ity which is not basically different from that of 
the other pehaviors of the body, such as muscular 
movement, sensation, Or digestion. Thus such a 
postulate may be useful to some in describing cer- 
tain aspects of human behavior, butthereis a lack 
of evidence to show that psychic energy exists or 
is different from bio-chemical energy. 

Motivation may be described as the result of a 


At one time, mot 


ed bibliography at the end of this par- 
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need or deficiency in the organism, so that an or- 
ganism lacking in food might be motivated to eat, 
апа so on. However, it is pointed out (34: 27) that 
in animal studies, hunger may increase activity 
for perhaps four days, but that after this, activ- 
ity decreases. An element of expectation must 
therefore enter the picture, so that motivation is 
not related to need alone, although needs must 
necessarily be a factor. 

We can also examine motivation as reaction to 
Stimulus, in that deficiencies in water content of 
the organism, food lack, orthe prick of a pin ac- 
tivates the organism through internal or external 
Stimulation. It is evident that many internal and 
external stimuli are acting upon one at any given 
moment, so that stimulus patterns may be ex- 
tremely complicated. Some stimuli are persis- 
tent, as in the case of hun 
behavior be maintai 
Other stimuli, 
arouse only Пе 
need, stimulat 


Xplanation (especially in 
regard to human motivation). 


vironment, and that “hunger drive,” 


; pain a- 
voidance,’’ etc., are really only individual man- 
ifestations of the basic over-all 


make much of the role of Self p 


human organism to <“ 


» devel- 


ng Satisfaction from their 
use. 


Motivation as Viewed for the Present Discussion 


as patterns of persistent Stimulation that induce 


A drive originates in 
Sult from needs for 
may be a function of 


we attempt to avoid 
of a pin. 


Having been aroused, the behavior of ib 
ganism is in the direction of reducing ы ШШ, 
or, to put it another way, to remove the s nd to 

Thus we learn to seek definite goals, à on 
respond accordingly. Precisely how we аня 
is a function of the various internal and ped us- 
Stimuli acting upon us, and our learned, eather 
ually habitual, ways of coping. Itis inthis cer- 
basic way that we learn to perceive, finding Pues 
tain elements in the environment that act as 
to drive-reducing behaviors. iron- 

As a result оне with the pci 
ment, we find pleasant or unpleasant Lene nd 
ces, hence drive reduction or drive ens 
tion, or perhaps the initiation of new ес poth 
develop feeling tones or emotions, which p is, 
biological and intellectual in character. aid or 
we both recognize that we are angry or ae re- 
happy, and physical changes accompany conser 
cognition. Emotions, thus learned deem ex- 
quences of behavior, develop along with i when 
pectancies of the situation, as for examp E too 
we become anxious at the thought of having é 
pulled. Emotions can then become drives; 
cause us to modify our behavior. né only 

Although originally motivation can "E status» 
from drives related to one’s psysiologic nature: 
one learns or acquires drives of a social Paul 
Through consequences of be havior (pleas _paim 
pleasant, reward-punishment, pleasure to еп” 
negative-positive reinforcement), we learn or 
Баве in certain activities and not in per other 
example, we may learn to be friendly havior 
People, since we have found this sort of beha” ye 
usually results in pleasant Consequence” 
learn to be aggressive, def ending ourse i 
gaining drive reduction of fear , pain avo 
threat to the self. s we find 

Among the socially derived motives other?’ 
mentioned are motives to seek approval j enjoy 
to master one’s tasks, to gain attention, is leal" 
new experience, and many others. een ate? 
ed, over a period of time, insofar as it nie are 
to earlier drives and drive reduction, W e 
thought to be originally biological in natur ел" 

Such learning occurs in early еш!аноо m is 
eral patterns of approach-withdrawal, 5 otio y 
Sion or dominance, particular goals, e md ear, 
and other motivational aspects de velop} ly jer 
aS a consequence. (We are not yet entire o her 
as to the extent that temperament, relate cese o. 
edity, plays a part through the bodily prO ify P? 
earning continues throughout life to mo 
tivation, as well as reactive behavior. . level? of 

Motives can be described at various ect? 
generalization. Some permeate most weil oe 
our lives, whereas others are more ae ра? ig 
given situations. Some appear to represe rly 
Personality characteristics, developed € 


n 
54 
е сё, 
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life, whi 
ee ee NE represent more easily modified 
of motives ics of the individual. Generalization 
we learn Lee and responses takes place as 
act to ide em thus develop broader goals, re- 
— ways. ried stimuli, and respond in more 

e à 
Some ae to internalize, and make our own, 
When a litt] motives and wishes of others, as 
learn to ees learns to keep clean, or when we 
cause we h relief from feelings of guilt raised 
Society, go ave accepted mores and values of our 
ing one’s ee motivational patterns change dur- 
Stant, It ig 3] others remaining relatively con- 
Precisely S also probable that no t wo of us have 
°S within a he same systems of motives, likeness- 
learning puo representing the effects of 
individuals nd even within a culture, there are 
norms” whose motives differ widely from the 

Ti anra . 
both the em one's motives are related to 
ment, and о (stimuli) he possesses atthat mo- 
Ndencies е individual habits or response 
e employs to reduce those drives (re- 


Move 
cL 
пеар кыы ne There are both personality 
itions (primarily learned) and momen- 
hich combine in 


Y envi 
lege influences, w 
e pier: to influence behavior (34). 

ron essenti ancy value of the immediate situa- 
educe ç; ially determines how one shall reactto 
Situation (Lun drives. I there is ambiguity in the 

ti ау conn; wo or more expectancies), our motives 
10 ict and behavior become anxious, emo- 


olives inefficient. 
Onscious ; may be differentiated atahigh level of 
Seno acai. or with various degrees о 
of Cape A OO we may employ various 
Our moti defense mechanisms, disguising some 
in Attitudes m even from ourselves. | 
(33, “SPOnse how d be defined as motives organized 
ng 22). Thee situation, or institution 
“fg T€ basi ey are a personal evaluative reaction 
Or? gy < caly either acceptant or rejeotant, 
against" something. They may be of 


Vary; 

Intec ae of intensity. | 
highly 50 tha may be defined as intensity of atti- 
le ly inte at one may be of favorable attitude and 

arly “rested, of neutral attitude and not par- 

interested, or of some other combina- 


tion е 


DRI 
Biologia ACTIVITY is aroused 
Inte Stent or social Ехресіайон 
B B Stimuli Goal oriente 
Moti М T external Emotions 
Attitudes 
Interests 
Values 
Purposes 


The Self 


tion of attitude and i 
of reaction. We Henin ya des Sm dieeotton 
tively toward something to which a ite: ees 
favorable, but react against or VASA ue 
titude were unfavorable. How strongl iden 
is the result of intensity of interest. Attit s 
~ interests are both learnedfrom ee 
ا‎ meri to situations, drives either being res 
Values may be described as i i 
tudes. Purposes may be es 1 Tv 
resentations of the goals one has in mind 4 SO 
being the end activity that terminates some d 
behavior (as eating may be the goal of S opel a 
motivated by hunger stimuli). Our goals are ed 
iginally learned, so that we need to experience 
the consequences of behavior which is motivated 
before we can understand whatour goals are 
For example, the tiny baby does not know that 
eating will relieve his hunger drive, and indeed 
does not know that he is hungry. But when he has 
eaten and his drive is reduced, he learnsto have 


eating as one of his goals. 
re external stimuli introduced to 


Incentives a: 
They introduce the element of ex- 


motivate one. 
pectancy, and act as potential reward, or as 
goals for the behavior we wishto initiate. They 
need not be related directly to the behavior being 
to reduce other drives 


fostered, but may serve 
tiate. Thus we may offer 


which they may also ini 

money for the digging of a ditch. The digging re- 

sponse does not satisfy the hunger drive , but 

leads to the attainment of the incentive, money 

which in turn may be used to purchase food which 
duce the hunger drive. Incentives, 


will, in turn, re 
d, are intermediate variables in 


thus conceive 


drive reduction. 
Diagrammatically, we can represent motiva- 


tion as shown at the bottom of the page. 


It will be noted that several principles have 
peen put forth. The firstis that activity is not 
aroused without the presence of stimuli, and that 
truly motivated pehavior (not reflexive) requires 

Activity results in the seek- 


persistent stimuli. 
ing of goals, and the stimuli to which one re- 


e— > DRIVES ARE REDUCED 


‘PONSES аге mad 
RPS jona Removal of stimuli 
Habitual Consequences 
Learne Learning 
Trial and error Further motivation 
Emotions 


Emotions 
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sponds, environmental in character, depend upon 
the drive in operation. Responses are either 
learned or habitual, or tentative, the consequen- 
ces of the response resulting in removal of the 
persistent activating stimuli (drive reduction, 
Stimulus removal) or not. Although this sounds 
as if all stimuli were unpleasant and the organism 
were in a constant state of atte mpting to escape 
such unpleasantness, this is not a necessary as- 
sumption. We can conceive of motivation in this 
context more as analagous to the electric refrig- 
erator, which has automatic switches connected 
with thermostats. Whenthe refrigerator gets too 
warm, this is made known to the switches by the 
thermostats, and the machine turns itself on. 
When the proper temperature is reached, the ma- 
chine switches itself off. It is not nece ssary to 
postulate feelings of pleasure or painin regard to 
the stimuli, although it is true that these fre- 
quently accompany motivational states. 

Motives are influenced by the consequences of 
our actions. This principle leads us to consider 
not only expectancies concerning the outcomes of 
our responses, but also the situations in which 
we find ourselves, and further, to generalizations 
about ourselves as usually able to cope with our 
environment and needs, or not. Maslow (28) has 
Suggested that the dimensions of Self-esteem and 
Security are extremely important in this regard. 
If one is both high in self-esteem and Security— 
confident in his relationship to his environm e nt, 
usually in a social sense-- he is 1 ikely to bea 
leader or a Strong follower, and his motives and 
their expression through behavior will be differ- 
ent from those of one who lacks self-esteem, se- 
curity, or both. 

Performance, as in teaching, is now seen to 
be a function of several variables; 

a. One’s potential. His know 

gence, developmental level, etc. 

b. One's cognition of the situation. His per- 

Ception, based upon knowledge, expectan- 
Cy, the situation itself. 

с. One's motivation. His drives, goals,emo- 

tional status. 

d. The environment itself. As 

tor in performance. 

e. Personality variables. 

habitual behavior (trait 

We can now argue a progre 
consider that 

a. the motives, themselves, 1 

Seeking activity; and 
b. one's expectancies about himself and the 
Situation lead to choice of behavior; and 
C. behavior results, as a function of percep- 
tion of the Situation; resulting in 
consequences of behavior; which further 
modifies perceptions, and leadsto d rive 


ledge, intelli- 


a limiting fac- 
Temperament, 
S, types, etc.). 

Ssion in which we 


ead to goal- 


reduction, or not. 

Emotional time may accompany all elem = 2 
of this progression, acting as drive, in as 
expectancy, and consequence. Consequence 
to learning, and to modification of perception. 


Considerations in Studying Motivations of 
Teachers 


When studying the motivations of eir as 
related to teaching efficiency, then, sever D 
ments must be considered. These may be gr 
ed under two main headings: | en 

a. the needs or drives; expectancies is 8; 

ceptions; and consequences of teac is. 
as they affect the ways the teacher ac um 

b. the needs or drives; expectancies or is 

ceptions; and consequences for pupils, ай 
low staff, parents, ашташат. 
community, of the way the teacher A 6 

The first group will determine how well id 
fied the teacher is, and this is relatedto hi5 Pr 
formance. The second group determines i Ka 
how the performance of the teacher, howeve 
tivated, is evaluated. hen be 

The following specific questions may t 
asked: — Бан 
Regarding the motivation of the teacher— maT? 

+ Why is the teacher interested in ignis, 
How long has he held theseinterests? Ном 5 
are they? How changeable? ing, 

2. What are the exei benefits of teach] 
as the teacher sees them? What are his eXP 
difficulties or dislikes in teaching? with 

3. How satisfied has the teacher beer. ion 
teaching, Student-teaching, or similar expe 
ces? 


(vas 
4. How legitimate are the teacher's motive 
How realistic? 
5. How does he perceive himself? 
6. What are the teacher's particular £ 
How are they related to his motives? EE 
T. How do situational factors and habitu 
Sponses affect his drive reduction? ә P 
Are the teacher’s goals attainable 
what extent? ;en intel” 
ы Which drives are reduced and which 0 
Sifie through teaching? ich t 
Which are related to teaching and е 7 
t 


oals? 


other areas of his life? 


| exi? 
11. What age, sex, or other differences 
How do his motives change? ing be 
12. Do the consequences of his teaching 


vior relate well to his expectations? s? J 
What is the hierarchy of his motiveS* „ja 
14. Are his motives appropriate, ina 9 
Sense? 


— f 
Regarding the ways the teacher responds. yjor e 
l. How satisfying to others is the be 
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the teacher? 
tic a expectations about the teacher realis- 
sonable? 
throu me pupil needs satisfied or hindered 
gh his teaching? 
teacher | ent conflict betweenthe roles the 
5. us Sus and the expectations of others? 
Deeds seem е eneber e ways of satisfying his 
. 6. Is hi armful to pupils or others? 
tions is effect on all pupils or in all situa- 
mee same? 
e oot we ask about the ‘‘motivation’’ of 
» for incl we are really asking no question at 
riables ivation must be defined interms of the 
It is 5, we have mentioned. 
effects E surprising to find that the teac her's 
tion and B variable; that he can failin one situa- 
find (12) re well in another. We are beginning to 
different hat the teacher affects various pupils 
Combinati, and that one's teaching efficiency is a 
the Patte lon of pupil-teacher-situational factors, 
n mr of which we know very little. — — 
Studies consideration of the findings of various 
teachin, related to the motivation of teachers and 
ену of genes we shall be aware of the com- 
tai akea the problem. But we may expect cer- 
E much E enlightenment, while rec ognizing 
MiB Pot iore studied. We shall group 
ant Same into three headings: 
Profession. of why teachers chose teact 
NC a ies of teacher attributes. — 
a ys of teacher and others’ sati 
e a ances, 
оь bes recognize that there are two 
ly Ce idered: 
macs 0 а motives may be rel 
Y Or ma. Chers or to teacher be 
not V Satist not be rated as excellent by others- 
beh, be beê n of teacher motives may or MAY 
2Viors а nt. This, in turn, may affect their 
ugg th ii subsequent successes OF lacks. 
Sion. S of studies are present in our dis- 


Wh 
dn 
hers Choose to Teach 
hose 


act 194g 

mor ing as Best (3) found that pers я 
а profession bel ie ved teaching to 

q , c profession to be 
Nate Орро ere wasless phy 

th tte peer їшї A ade- 

he ۾‎ nity for proper home life, ep gain 


va 


hing as 


sfactions 


spects 


ated to certain 
havior, which 


etime j 
Do, ledeg we inc ; asi 
Sitio Sd е ome, that it was e a 
tain COn fro ducation, and that there es 


Q Siler ж parents and relatives t 
Pug ties b Ofessions. " 
argo (9), ge (5), Cramer (6); Eliassen n 
an y (10), Harris (11), Hollis (22) 
arzolf (20), Lawton ( 1) Lee , 


Orton (24), Seagoe (33), Thurman (38), Tudhope 
(39), Valentine (40), and Yeager (41) tend to indi- 
cate a relatively small number of reasons listed 
by students for the choice of teaching as a profes- 
sion. Fox and Richey (8) found variables of “‘se- 
curity, ’’ chance for advancement, good working 
conditions, pleasing environment, chance to serve 
society, work with young people, prestige, per- 
sonal satisfaction, social contacts, andother fac- 
tors as advantages seen by prospective teachers. 
But there were disadvantages, including low pay; 
restricted private life, poor working conditions, 
monotony, parental disapproval, responsibility, 
‘nerve strain", too many bosses, low social 
standing, lack of prestige, lack of academic free- 
dom, little tenure, politics, and other factors 
seen by those not intending to teach. 

Accordingly, Ringness (31) in 1951 employed 
a composite of reasons from these studies in his 
attempt to see how motivation of teachers was re- 
lated to teaching efficiency. In this study, it was 
postulated that the reasons given for choice of 
teaching as a profession were at the level of Cat- 
tell’s surface traits. It was believed that through 
factor analysis, “surface trait’ information, col- 
lected through tests and questionnaires, could be 
reduced to the level of “source traits." Accord- 
ing to Catte l1 (4), surface traits may be a com- 
pination of environmental and cons titutional as- 
pects of personality, and may be approached by 
observation of pehavior and by testing. Source 
traits are deep, underlying traits, and may be 
approached by factor analysis of surface traits. 
Interests are dynamic personality traits. Basic 
drives and acquired interests may be described 
as source traits and surface traits. 

Another Way of stating this might be to suggest 
that specific attitudes, £O als, or values may be 
reduced to more generalized attitudes, goals, or 
It was reasoned that such generalized 
al factors might be found manifested 
consistently throughout teacher be havior, and 
hence reflect in teaching success or lack thereof. 

In this study, only secondary school teaching 
candidates were studied, a notable lack, but ne- 

e the training institution did not 
eachers at that time. Sixty- 
and 37 women seniors were studied, 
e, 16 men and 18 women were visited 

heir first teaching positions. 
en were not visited. 
1у ten had accepted teaching 
ноп too far away 


g. A commen 
ssion is evident. This is also 


a reflectio h of (reported) motivation, 
and the possi > ts that student reports of 
attitudes were not highly valid, or else that their 
motivations C within the year, 
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During the period of the study, there was a short- 
age of teachers. 

A paired-comparison test and a ranking ques- 
tionnaire were devised, employing 13 reasons for 
choice of teaching as a career: the beliefs of rel- 
atively good financial reward; ease ofobtaining 
necessary education; security against jobloss and 
layoffs; clean and attractive physical surround- 
ings; short working hours and frequent vacations; 
opportunity for professional advancement; oppor- 
tunity to serve society; prestige and respect of the 
profession; ease of obtaining a position; opportun- 
ity to pursue a favorite (subject matter) interest; 
variety of activities and little monotony; environ- 
ment of interesting co-workers; and relative lack 
of physical strain. Itis interes ting to see that 
Some of these ‘‘reasons’’ reflect popular stereo- 
types, but not reality. For example, frequent 
vacations” often are, to the practice teacher, a 
chance to catch up on work in which he has drop- 
ped behind. Summer vacations are seen more 
comparable to factory lay-offs, since one is not 
paid for such time off. The‘‘short hours” do not 
include the grading of papers, preparing lessons 
at home, etc. 

Both the paired-comparison test and ranking 
questionnaire employed the same items, since the 
circularity of the first instrument might be pre- 
sumed to offset the probable ine qualities of dis- 
tance in the second. Both have the disadvantages 
of any self report Scale, so that we should not be 
Surprised to find differences in patterns of choice 
on the two instruments as used by any one student. 

Such indeed was the case. The resulting fac- 
tor analyses provided no useful data, so the re- 
sults will not be considered here. However, in 
terms of raw data, the paired-comparisontest 
and ranking questionnaire provide considerable 
interest and show consistency. In order of rank, 


the reasons for choice obtained from the paired- 
comparison test are shown below. 


MEN 


A variety of comments may be made at boe 
point. We may first raise the question of ү. of 
we are getting at the real reasons for chore TA 
teaching as a profession, or whether we wed 
ting an echo of the popular stereotype of teac aah 
We note sex differences, as expected, in a te 
ue systems of men and women. We also no three 
disdain with which the possibly insulting last 
items were treated. г 

The ranking questionnaire produced essentiam 
the same results. Differences in factor T Ute 
results appeared linked to the patterns O UN 
of the particular subjects, rather than the bes 
all order of items as given by the group 


whole. with 13 


si- 
other occupations, those of medicine, law, Di 
ness management, sales, journalism, eng? 
ing, the ministry, social work, advertise, 
oratory research, accounting, farming, ^x these 
tainment (the stage), teaching was ranked T ni 
subjects as is shown at the top of the next = e off 
The teaching profession does not vias . it 
poorly except in the area of financial rewa” sti- 
is also evident that at least at this training дей 
tution, the teaching preparation is not MT 
as a program of “snap” courses. Thus, E. a, the 
is thought to provide attractive surrounding’ ‘pure 
work is not arduous, there is opportunity ^. a 
sue a favorite subject matter interest, t jety- 
interesting co-workers, and plenty of И оп. 
а word, teaching is a pleasurable occupat? jes! 
From a check-list and from autobiogr?P. re 
it seemed that influences on the choice " one - 
were largely those of individual study % f gg 0! 
own interests and capabilities, and the ЧГЁ 2сп 


jn 


teachers and/or parents. Major interest wt gu 
ing seemed to have been long-lived for ™ r are 
jects, and centered in the subject m ano pe "e 
rather than in children as such. It sho s in и 
ed that there were no elementary teacher 


WOMEN 
Opportunity to pursue favorite ( 


Subject matter) 
interest. 


Opportunity to serve society. 

Variety of activities, little monotony. 
Security against layoffs, job loss. 
Environment of interesting co-workers. 
Prestige and respect of profession. 
Clean, attractive physical surroundings. 
Opportunity for professional advancement. 
Short hours, frequent vacations. 
Financial reward. 

Ease of getting necessary education. 
Ease of obtaining position. 

Lack of physical strain. 


Opportunity to serve society. . 
Opportunity to pursue favorite (subjec 
interest. 
Environment of interesting co-workers: 
Variety of activities, little monotony- 
Prestige and respect of profession. 
Security against job loss, layoffs. _ 5 
Clean, attractive physical surrounding 
Financial reward. 
Short hours, frequent vacations. 
Opportunity for professional advance 
Ease of getting necessary education. 
Ease of obtaining position. 
Lack of physical strain. 
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Financial reward 

Ease of getting education 
Security against job loss 
Attractive surroundings 
Working hours, vacations 
Professional advancement 
Service to society 
Prestige, respect 

Ease of getting position 
Opportunity for favorite interests 
Variety of activities 
Interesting co-workers 
Lack of physical strain 
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№ g the second year of the st 
e criterion of 


ere as 
“acceptability” a the field, using th 
15 defined ity’ as a measure of success. This 
eads othe as “the quality of the teacher which 
Position ee to feel that she should be retained in 
ing i possibly promoted, ” and is defended 

nto account the varying expectancies, 


id 
» Toles, values, and other variables of the 
nt. Teachers 


ers and by the 
cceptability 
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uties 


tea 
cher 

an 
Were d her teaching environme 


e 
rat 
teachers” s by two University observ 
atin ei upervisors, a composite à 
hoi a 
Кге QU ations between items of the 
high 2T me ruments and acceptability ratings were 
a n and .78 for women. These are not 


twa Multi а 
Wee iple R’s, but show some relationship Þe- 
d teaching 


s re 
on Cess. Tha for choice of teaching an 
Эрот, ВАЕ le, the belief. Фа teaching offers 
Tite int Y to serve society and to pur? ue a fa- 
to gating in hat teaching is 1- 
erentj а variety of ways se likely 
This ching late successful te ac 
tion, OES as an easy, secure sor 
s lic, ПОЕ surprise us, for th 
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^ are demonstrations of positi а 
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ration, lacka- 
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Seta t attit to low level of aspi 
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lew 
> Wi of ch à the pres- 
tears Tai anges between 1949 an : 
Side; Aching ^e Several questions: th perception 
eee chan, a profession the same (0 ay, 
thang, Nent, Ses in salary schedules, £ 
ч бе? char new buildings, teacher 
= he king of ges in teaching О ject 9 
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Women 
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upils, increased homogene- 

teaching machines, televi- 
ttitudes had on teaching 
her motivation in partic- 
ith elementary teaching candi- 
n struck with the num- 
to work with primary level child- 
theupper grades,be- 


d not so hard to live 


examined responses of high 


tructured situations 


hing as a Career. *tProjective" 


concerning teac 
anecdotes Were employed, and subjec ts were 
studied using the Bell Adjustment Inventory and 
the Strong vocational Interest Blank. The father’s 
occupation was also considered. Of these stu- 
dents, the following percentages described teach- 
ing unfavorably: 
Low pay 29% 
piscipline 22% 
Long hours 18% 
Dull, poring 14% 
Limited opportunity 14% 
Lack of ability 12% 
Too much education required 8% 
nts were obviously considering not 


These stude 


motives and abilities, but the ex- 


y thel о 1 
periences they have had in school. On the other 
hand, favorable responses were as follows: 

Like children 52% 
Help society 48% 
Interest in people 19% 
security 16% 
satisfaction in watching 
children grow and learn 16% 
Good people to work with 54% 
od hours 329; 
Job satisfaction 27% 

However, in the response to ambiguous ‘‘pro- 

jective” device situations, there was a tendency 
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to describe teachers as ineffective and unattrac- 
tive. Possibly this represents the stereotyped at- 
titude of pupils to teachers, but since choice of 
career is often made at thistime, a need for 
changing such stereotypes is indicated. 

The Bell, Strong, and (used in oneinstance) 
Kuder tests were found ineffective in relation to 
the projective measure employed. 


Studies of Teacher Attributes 


Hellfritzsch (13) attempted factor analysis ofa 
number of measures frequently used in investi- 
gating the nature of teaching ability. Employing 
teachers of social studies in non-departmentaliz- 
ed eighth grade rooms during one year and in one- 
room rural schools during a second year, he first 
looked at the characteristics of pupils. These 
were given pre- and post-tests of social studies, 
and reading and intelligence tests were employed 
to examine possible differences in these forms of 
readiness. Pupil gains onthe social studies tests 
were developed into an index of teaching efficiency. 
Teachers were given tests of intelligence, know- 
ledge of subject matter, personality, professional 
aptitude, social attitudes, and other Special tests. 
They were also rated by their supervisors on var- 
ious scales. 

Certain factors emerged, not unexpectedl У, 
considering the instruments employed. These 
were a factor of general knowledge and mental 
ability; of personal and social adjustment; of “еџ- 
logizing attitude toward the teaching profession"; 
and of teaching ratings by supervisors. Inconsid- 
ering the special factor of Supervisory ratings, it 
was shown that such ratings were not related to 
pupil gain, knowledge of the Subject, mental abil- 
ity, or social and emotional adjustment, but were 
apparently, generally Speaking, divorced from 
any of the **objective" measures em ployed. It 
was hypothesized that Supervisory ratings must 
have been related to the indivi dual ideas of the 
rater as he observed relatively minor teacher- 
pupil behavior. We may consider whether the 
raters in this study had definite behaviors they 
were looking for, and if so, what the basis for 
choice of such specifics might have been. Was 
the training of the raters adequate? Reliabl 

The ‘‘eulogizing attitude” to p en 

i ward the teaching 
profession appears related to motivation and job 
satisfaction. The general tenor was that ‘‘teach- 
ers are good--pupils are good” — а rather eu- 


phoric attitude. This could also be related 
mental health of the teacher. теше 


In the first year of the study, 
cluded that pupil gain was most highly correlated 
with the general knowledge and mental ability of 
the teacher. 


In the second year of the study, 


Hellfritzsch con- 


a fifth factor, 


that of ‘‘teaching ability" was isolated, ape 
pupil gain in the one-room rural schools peret 
related only to the teacher's liberal social oe 
and to sound working knowledge of sym B eae 
causes, and remedies of pupil adjustment dif po 
ties. Differences were found in the common (e 
tor composition for the four-room state gr en 
school teachers and the one-room rural teac! the 
not surprising in view of the differences in 


» were 
roles of these teachers. ''Teacher factors i the 
found more important than “pupil factors ae 


state graded schools, contrary to results - tie 
one-room rural schools, probably because PP ¢, 
rural schools pupils were left more to study ess 
their own,’’ each pupil actually receiving 
teacher guidance by comparison. h 
Hellfritzsch further emphasizes that alth ee 
he was able to relate mental ability and s a al- 
matter knowledge in the one study, and 5075. 
titudes and understanding of pupils inthe nore Ni 
pupil gain, that no single factor could be pecori 
ed important by itself in influencing such £ Hon 
In effect, we have in this study an itera ac 
the complexity of the task of relating е Б 
success’’ to some hopefully predictive var re ap" 
related to the teacher or his training. It i25 
parent that teaching efficiency is a function nc 
particular role, and the extent of his ind کن‎ 
not easily ascertained. Thateven when AID jon а 
ed” by such an apparently objective criter give? 
pupil gain, we cannot relate efficiency to PYÈ е 
teacher variable. It is evident that what iu ive 
been doing in many studies is adding predi , е 
measure after predictive measure, hopin£ tea per 
composite may be more closely related to oe 
success than any one instrument, and that W? це 
reduce the manifold dimensions of the COMP” js 
by turning to factor analysis. Yet such Us rhe or. 
can only reduce the elements employed in ^^ 
iginal measurements, and if these do p 
the required hypothetical relationship 10 еспліа0 
efficiency, this sophisticated statistical are tor 
will not help us. А few large multiple CO put W 
coefficients would perhaps be more изе!» 
do not have these either. facto" of 
Yet Hellfritzsch’s study does show 2 result a 
'*eulogizing the profession, ” in part gest p 
a teacher attitude inventory, and may 5 ;n fut? 
Such attitudes ought to be considered nêy 
studies of prediction of teaching ا‎ to ” 
Insofar as personality may be relate tion: 16 
vation through such variables as percer rge’ pa 
of aspiration, general surgency Or be cm [o 
Lamke's (19) study is probably pec y r 
we may expect. Using a paired-comP^. fact 
based on Cattell’s 20 surface traits xa e 
the results, Lamke related these to Ше сіепсу d 
ceptability'' criterion of tea c hing pm the ° 
ployed by Ringness, and, infact, US 
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subje 
па Тахь, Ringness, and Bach were the 
low-up е RUNE and raters during the fol- 

бате ее subjects in their first positions. 
and poor ie some relationship between good 
Surgency ad ers and tests of surgency vs. de- 
Withdrawn s bees del cyclothemia vs. inherent 
rough sim 1 izothemia, and sophis tication vs. 
found to 9 icity. Thus, good teachers меге 
lud ы ee talkative, cheerful, placid, 
Silent, de quick, while poor teachers were more 
азони ens anxious, languid, and uncom- 
Eregarious. Good teachers werefound to be more 
undance of adventurous, frivolous; to have ап a- 
Ог sentim emotional responses, strong artistic 
the бр interests, andto be interested in 
€ more eM Sex, but poor teachers were found to 
motional y, cautious, conscientious, lacking in 
menta] int response, lacking in artistic Or senti- 
M the op erests, and to have only slight interest 
Werage posite sex. Good teachers Were found 
and кї tendencies to be polished, fastidious, 
9. Ther, but poor teachers were below aver- 
Please pt nes were clumsier, more easily 
Jess more attentive to people. But, con- 
th Ore likely’ a balance among personality traits 
hie extremi to be related to tea c hing Success 
ing may ed on any variable. Too much of any- 

This esa as debilitating as too little. 
dc Chers, vss to say that possibly the poor 
ang °° of Medus by Lamke, had hada lesser 
m m gap e е the good teachers, 
hay Оп, and re motivated more toward security, 
int, lor, Ap rather repressed, conservative be- 
à ested Pparently such teachers would be more 
1 the adim. the security of the profession, rather 
in die m of pupil and staff contact. 

eir. CTS, Ac Studied the social competence of 
Suc Габра ploying tape recordings, teacher 
ess 188, and ratings by others in estimating 


hr à 

er. Bether employed certain scales of the MM 

Varja Ch with social distance scales of teach- 
dent-teacher 


y: er 
tong ев. : geacher-student, and stu 
Petes ID betwe, found har there was: Бате VEIT 
is een teaching success and social com^ 


ang ту, а 
leader wd between leadership in the classroom 


Bur rsh 
Olle не; 2 ORE the staff. id 
itg SAgueg "Perception of how опе is десей a 


e o : 
m relation Students, according to Singer» 

dig ad to success in teaching- Appar- 
th У егеп her himself, and others, are looking 

S mate thi things when evaluating teaching. 
degg tiva Study i i lated to 
ats lVatign udy is only tangentially TE the 

latittistact; ОЁ teachers, it does show that 
Sia Seg UD t of the teacher may 
кау сер e reality of the situs 
Bly, “SPtion and that of others 4 
апа aca it is evident from the leac" 
at t i competence aspect? aiio) 
€ with strong motives (and ability 


to lead and to interact with other 
s 
more successíul. dide: 


Studies of Teacher Satisfactions and Annoyances 


It is readily understood that if one enters the 
teaching profession for certain reasons, and, ei- 
ther because of pupil, administrative, community. 
or other situational inadequacies, he is not able 
to satisfy his needs, his moti vations will either 
have to change, or his happiness, and hence his 
efficiency. Not only may situational variables re- 
lated to the position be like or unlike the expec- 
tancies of the teacher, but it is also true thatthe 
teacher may espouse a different set of values 
from the administrator Or the community, and 
therefore be classified as in efficient because of 
these differences in expectancies. 
This relationship is complex, and may lead us 
o areas of the training of the teacher, Sex dif- 
e differences, perso nality, values, 
and other relationships, plus the whole host of 
community and situational variables hindering or 
enhancing the teacher's work. Worse, who will 
the teacher attempt to satisfy? Himself alone? 
Some of his pupils? Certain parents? The ad- 


ministrator? For concepts of the good teacher’ 
even within one of these groups. 


may vary greatly, 
Thus we may either have teachers whose needs 
d, or who fail to satisfy others, due 
t to the nature of their motives. In 
se, such à teacher may not be very ef- 
make good in one situa- 
As Barr indicates (2), 
investigators that 
rn school involves much more 


int 
ferences, ag 


are unsatisfie 


either Cà: 
fective. 


“Jt is perfectly 
the mode 


administrator relationships, and teacher-com- 
i ips; and many important re- 
sponsib: ng out of these. These rela- 
i ill limit in a s ignific ant respect the 
uccess in à given situation and ulti- 
il growth and achievement. ”’ 
Having considered the work of many persons, 
nsen (25), Hoppock (15), Lichliter (23), 
7), andMcCluskey (29), Mar- 
e whether certain teach- 
«(correctly placed, ээ using a satiafaction 
a teacher attitude inventory and the 
efficiency. In this study, he 
n scores with rating 


ers Were 
score from 


ationship of this to ‹ 
i ed teacher satisfactio 


i i i M-Blank, as 
Wisconsin adaptation of the š 
on the te of teacher success. He found that 

j e more satisfied than dis- 


and that only 4% were defi- 
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community friendly, and the education philosophy 
of the administration satisfactory. Fifty percent 
found churches, meal accommodations, commun- 
ity demands, administrative policies, the curric- 
ulum, teachers’ meetings, instructional mater- 
ials, the faculty, teaching load, and salary satis- 
factory. (It must be remembered that the sample 
was voluntary and consisted of first-year teach- 
ers. These may have tended to be more satisfied 
than experienced teachers. ) 

The main area of dissatisfaction was with cul- 
tural opportunities in the community where teach- 
ing. Interestingly, interms of family background, 
those who had been brought up with less privilege 
were least satisfied--did they expect too much in 
terms of social mobility from teaching? Further, 
since dissatisfaction tended to be related to the 
lack of cultural opportunities, such as museums, 
zoos, the theater, did this really reflecta sort of 
‘homesickness for the campus"? 

There was found a low (.19) positive correla- 
tion between teacher satisfac tion andsuccess. 
But, as Martindale points out, “this Study was 
limited to the more tangible factors; the signifi- 
cance for teaching efficiency m ight lie more in 
attitudes, values, the prestige factor, etc....” 
Case studies presented tend to show that Satisfied 
teachers have lived stable, desirable lives, while 
the dissatisfied teacher S had various trauma— 
parents, moving frequently, early school year 
problems, etc., —our conclusion, rather than that 
of Martindale, 

Knox (18) considered the environme 
on teachers. He found that a 
condition may be present, but 
dividual may, because of his 


ntal press 
potentially upsetting 
that a particular in- 
temperament or 


» most 
nably happy with administrative per- 
Sonnel, procedures of the faculty, the particular 
teaching Station, school or ganization, the com- 
munity in general, instructional materials, the 
plant, the people of the community, and the stu- 
dents. The teachers were least satisfied withthe 
attributes of the students. A low correlation be- 
tween teacher satisfaction and efficienc y was 
found, 

Kline (17) in 1949 studied Satisfaction and an- 
noyance in teaching, finding annoyances relative 
to such matters as wanting and being expected to 
be knowledgeable about the individual childr en, 
providing for individual differences, and apparent 
feelings of restriction about the curriculum and 
about extra-class or extra-teaching duties, More 
seemed frustrated by not being able to accomplish 
what they desired than by inability to fulfill expec- 
tations of others. There were sex differences, 
more men reporting annoyances than Оше: 


п; dif- 
ferences in marital status, more married teach- 


hool 
ers reporting annoyances, perhaps due z itus 
duties interfering with home plans; an teacher 
found that the less the education of = annoy- 
(and presumably the younger?), the mor reported 
ance. Teachers in small com munities ime 
more annoyances than those of large zin annoy- 
Those with most experience reported mos alinse- 
ance. Does this also relate to apes 
curity, to less education, to changes m adminis- 
tions over the years, or differences e! military 
tration, or in the pupils? Those poene wi 
experience were more а a ^ outlook 
i ting c t ry; 
Such experience, sugges к ШЕ scii itary! 
Ў t fe 
Many hypotheses suggest themselves bi us- 
inferences may be drawn. Thereare EA 0 
ual problems of instrumentations and cr we d d 
efficiency tobe considered. Further, al as to 
Satisfaction as much related to person we may 
professional life. For these reaso nali seem 
hypothesize that the reasons teachers ds see 
reasonably realistic and that their n Sal those 
reasonably satisfied. It is probable s Rn thes 
who do not meet reasonable s ati facto out 
people move to other positions in 22 ate, ther 
teaching. Again, as data seem to indic aya tio? 
must be some relationships bangers a in t0? 
and teaching success, but it is in á, 
complex "bens to be yet well unda een y for 
There remains one other category о rs are 
us to consider—that of how well teac P 


18 
; this , 

judged to meet role expectancies. That нб p 
related to the teacher's motivation is e C 


e expe” 
that if the motives of the teacher and th are 


Ped jon) 9. 
tancies of the community (or administration) wil) 
congruent, it is more likely that the Legno ой, 
be found acceptable; but if the teacher gor 85. 
munity are emphasizing different val ye will " 
working at cross purposes, the teache 
less likely to be adjudged adequate. 

Manwiller (26) found that in genera 
and school board members seemed in pare ty 
regarding behaviors expected of teac cem Qn 
ligious life was the major area of a g T and Pere 
Civic and social life next in agreement, о T 
Sonal-family life and social and pecore jee ed re 
least. Distinction between what was € ity wie 
teachers and of others in Ње comm SP ne je 
found. In contrast to an earlier study, » gli 
roles of men and women were found t or pro joh 

Grotke (8a) em ployed the concept D ostul^ „р! 
sional distance” bas ed on Bogardus Puency аб, 
of social distance. Grotke felt that bad d p” 
degree of divergency between the teach ofes5 рё 
ministrator on what constitutes the pr now spe 
role of a good teacher might relate 


8 
her 
] peer ent 
T 


LU 
an" 537 

А ер И 
teacher was evaluated. The more ene FL 
points of view, the longer the profes 


h 
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tanc А 
Set 1o ie to be. Again wesee relation- 
аш стоти in the form of attitudes, values 
a ee study, certainambiguous state- 
оп yaro erning professional position (attitudes) 
ever, be wh = were used. He may, how- 
and thereto iticized in using admittedly ambiguous 
tems, and ге probably professionally neutral i- 
tudes and in working with relatively surface atti- 
Prising lid of be havior. It is not sur- 
is Pid erefore, to find that the hypothesis in 
ance was not supported. 


Conclusion 


w 
vation n Ye attempted to analyze the role of moti- 
бу, and а ОА Di teaching success ог efficien- 
Sa nen a considered several aspects:success 
teachin icing teacher; his satisfaction with 
ing о this satisfaction as related to teach- 
Seen thr Ss; and his motivations and responses as 
bh the expectant eyes of others. | 
Nambj re have we found relationships which are 
Quirements and useful for other than minimal re- 
tributes nts in prediction. Apparently certain at- 
tion for boris a necessary but not sufficient condi- 
apparently ins success, and some of these are 
аге in the lated to motivation. Other factors 
teac ere. abilities and other charac teristics of 
| in the administra- 


10п, th t 3 
life? „e Pupils, and the area of per sonal-family 


Le d w. E 
«teaching ` And it may also be assum 
fined ا‎ 


Per 
an mit no 


be we геавоцз, our studies are n 
ang Опе in "mii wish, and much wor 
of mini is area. Accordingly, supervisors 
whe er Strators are unable to judge the success 
= S with any high degree of accuracy 


meanings, and 
tion. For these 
ot as defini- 
k might well 


Һер ; 
о ег 
her cri ylation to pupil gain, personality, OF 
ria. Apparently expectations, protes. 
size 0 


Com dis 
loss aig ace, recency of training, 286, 
Ang Sight? Sex, and other factors cause us to 
d teachi 9Í basic relations between motivation 
m. Or the S Success. 
m € administrator we have s e V € 
Peay. dt 
NOM youa be well to examine the nature and 
X prospective teacher expectancies 
her’s attitudes, 


bjen, 16 
Пес 18 

Ctives р уа to check the teac 
t The emphases. | 
bu i мо hers satisfaction with 15. 
Carag term hy of study interms of his efficiency, 
er, Of recruitment and permanency of his 


we rate teachers 


ral com- 


m dards’ by which 
Ore clarification. 


For the researcher, it would a 
needs to be done in the area we We ce bee 
ing, and there are atleast four possible a 
proaches worth considering: ii 

a. We may need some “depth interviews, ” or 
other clinical techniques to discover mo tives 
goals, and satisfactions of specific teachers. i 

b. We may employ more use of analysis of 
variance, using teachers with multiple and com- 
parable classes, to attempt to rule out pupil and 
cultural variables and get closer to finding the 
real affects of the teacher. 

c. We may spend more 
teacher-pupil interaction, 
going on. 

d. We may pay m 
as a criterion of succe 
over time, rather than 


ually do. 
In teacher education, recruitment, orientation, 


placement, and in-service training, we may well 
consider teacher motivations more carefully, to- 
gether with their meanings and possible cons e- 


quences. We must consider further the choice of 
and subsequent drive re- 


goal, choice of response, 
d, the self concept, role 


duction. Anxiety, rewar 
expectancy, stereotypes— all need further clari- 
fication. This without forgetting inte lligence, 


other abilities, training, and other pre-determin- 
ing factors. Perhaps more comprehensive coop- 
erative research between schools, universities, 
the government, and certain pr i vate agencies is 
indicated. There is some indication of a need for 
an inter-disciplinary approachto these problems. 


time onthe classroom 
to see what is actually 


ore attention to pupil gain 
ss, the gains needing study 
“spot checking’’ as we us- 
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CHAPTER XI 


SOME ASSUMPTIONS, EXPLICITLY AND IMPLICITLY MADE, 
IN THE INVESTIGATIONS HERE SUMMARIZED 


D. A. WORCESTER 


In all studies of teaching effectiveness, certain 
assumptions have to be made, although not all of 
them have been explicitly stated. One way to ex- 
amine the fruitfulness of the studies here sum- 
marized is to note these assumptions and then try 
to determine the extent to which they have been 
verified. Some of the assumptions are in terms 
of general characteristics ortraits. Some are 
quite specific. Many of the apparently general 
factors involved are in reality composites, pos- 
sibly very complex composites. These will need 
to be examined in greater detail. Itis customary, 
for example, to speak of the efficient teacher, and 
we have many studies of teaching efficiency. 


What are some of the assumptions found in these 
investigations ? 


General Teaching Ability 


One hypothesis is that thereis a general 
teaching ability. It is frequently implied that 
some persons are just born withit. Bel ieving 
this, some feel, as William James did about in- 
Stincts, that it is not profitable toinvestigate fur- 
ther. All we need to do is to watch behavior to 
know whether or not an individual is effective as 
& teacher. Others who, perhaps, also accept the 
idea of a general ability to teach, think that we 
will identify the good teacher not by watching her 
behavior but by watching the pupils. The evidence 
of effective teaching is the change produced in 
pupils. In either сазе, there are various as- 
sumptions and implications involved. 

For example, in two studies (45, 66), the best 
teacher was defined as the one whose pupils made 
the greatest gains in knowledge of certain units 
of a particular subject; and attitudes, interests 
and appreciation in the general area of that sub- 
ject, taken singly or as composites. These were 
beginning teachers, graduates of the same insti- 
tution, in self-contained classrooms, in similar 
communities, who had volunteered to aid in the 
investigation. The pupils were inthe same grade 
and of similar Socio-economic background. Ap- 
propriate attention was given to mental abil ity, 
age, sex and previous educ ational achievement, 
Now what implications are present? 

One is that there is such a thin 


g asagood 
teacher. It should be noted th : 


at the investigators 


' heir 
disclaim any attempt to generalize beyond, ele 
present studies, but there is the aap sig- 
implication that the one whose pupils m a £% 
icant gains is a “good teacher. '' Otherwl ine 
measure such effectiveness? No one is £ wee 
employ a teacher just to teach two thre € 
units during the year to a single class. of re- 

There are two real values in this type re ef- 
Search. If one can discover how to meas ter 
fectiveness in a limited situation, he will К gener" 
it is assumed, to apply the technique pest ade- 
ally. That at least academic gains se dem” 
quately measured seems to have been YT ing the 
onstrated. Secondly, if, after identi Ye 
teacher whose pupils make the greater ga eacher 
can determine the characteristics of tha peha- 


or the particular elements of her tearing found 


ching’ 


It may be possible to predict te aching on 
іп general. Although much excellent [oes een 
been done, the number of implications P i ed- 
So great that a good deal more research 2 ade 
€d before these desired predictions can 

What are some of these implications? 


Effective in all Phases of the Subject 5 
ho 

It is implied, for example, that the опе охегей 
effective in teaching the particular ber unit 
in the study will be a good teacher in 0 ic ШҮ 
of the same subjects. This is a fairly 108) pt 
ference, although subject to a degree tration 
Some units involve, let us say, demons 


Effective in Other Conditions 
—— “Ve in Other Conditions 


wh? n 
It is implied, also, that the teach © байн 
Successful in the conditions of this inv me 09 
would be successful in teaching the § ahi infe 6 
under other conditions. Thisis a Чоно ac hf of 
ence. In some researches reported, ° caught pnt 
knew ahead of time what unit was to be es 9 pe 
the experiment, what were the objecti". s E } 
the length of the unit, that the class o or ype 
tested before and after teaching, and т, He 
à plausable hypothesis that in this Hn inse rav 
“best” teacher would turn out to be t ay 
teacher. Fearful of her ability, she 
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ine a efforts to secure results, driv- 
fects ang on this unit and neglecting other sub- 
asarei e curriculum. Possibly the more self- 
goca ob teacher, confident that she was doing a 
this Dari would get lesser results on the test oí 
this wal nk but might get greater ones in 
other sn. he long run and without neglecting 


eg e dried that a teacher who is effective in 
tions h jet 19 effective in others. Various condi- 
At the o» existed among the studies repor ted. 
Witenes ementary level, some have measured 
More SS of pupils in one subject in one of four or 
logie iene taught by one teacher. Some have 
jects ta or the gain in a unit of one of several sub- 
е sec ught in a single grade. Investigations 1n 
ngle на school have included teachers of a 
istor ubject—or at leat a single area, ё. g. 
ing int or music—and those who have been teach- 
tion нет than one content area. The imolica- 
Sat that the teacher whose pupils P ake gains 
ари) a social study will also secure gains in 
ison 68, reading or geography- When compar- 
Separate Ое of teachers who are effective In their 
ive iti Subjects with those who are not so effec- 
Perati is assumed that there is a common factor 
Conclusion, That is, of course, not a necessa ry 


Si 


Effect 
c k 
tive with All Kinds of Ability 


It ic ; 
tive yi implied that the teacher 15 equally effec- 
Stu i Children of varying mental ability. The 
i at reviewed in this monograph yield littlein- 
atten On this point. Usually there have been 
Socio ee to control such factors aS intelligence, 

à ra опошїс background and previous achieve- 
ki ae than to see if different types of teach- 
Childre especially effective with different types of 
ri Of 1o; Some studies have revealed that child- 
пап t Ow initial achievement hav € gai 


exp] Ose wh | as 
any ° Who started at a higher evel, 
: и s een interms of the 


Spec; ation S 
becia) . || Suggested has not b ñ 
king. Suitability of the teacher for pupils of that 


Et 


koi 
t 
Ye with Either Sex 


Th 
as ere į 
t Štfectivs the implication that mal 
{ 


асы е 

* as females. Most of t 1 

eg Ale, Sa participated in these studies were 
ave „ОП the secondary level 5 

ma erene aid, ie tention has been ee 

tle, * апа per in "háracterieties betwee? effecti 

> If an, “Male teachers, but there hë 


Y; evaluation of sex difference 


ing effectiveness as such. While š 
have shown that the pupils of one ses che та 
more than those of the other, no attempt has been 
made to identify particularteachers who are suc- 
cessful with boys or girls. Supervisors,how- 
ever, not uncommonly report that acertain teach- 
er is successful, say with girls, but іѕоуег- 
whelmed by the disciplinary problems of boys. 
We have here, as in most of the implications a- 
bove, what we may call sub-implications, that 
males, or females, not only are as effective with 
girls as with boys, but that they are equally as 
effective at each grade level, in each content sub- 
ject, in the development of character, social and 
emotional poise, and so on. In the United States 
during modern times there have been relatively 
few men teachers in the elementary grades. In 
many other countries, а large propor tion have 
been male. Whether or not there is a sex differ- 
ence in teaching effectiveness, and if so, whether 
it is general, at certain levels, ince rtain sub- 
jects, with certain types of children, is a matter 
for research. In this connection, the use of mas- 
culinity-femininity tests might be indicated. 


mportant assu mption is that 
ffective inanarea or in areas 
of academic learning is also effective in develop- 
ing other educational objectives. The Northwest 
Ordinance of 1187 stated that “Religion, morality 
and knowledge being necessary to good govern- 
ment and the happiness of m ankind, schools and 
the means of education shall forever be encourag- 
ed". Our schools have always accepted this com- 
o teaching character and citizens hip. 
d to make good boys out of bad 
boys. erequired by law that 
ion" be taught. Some research- 

knowledge of what one should do in 
-ic situations and what one's attitudes 

should be towards civic problems. None have at- 
etermine pupil gains in morality— in 
h—nor has there been evidence 
d to show increase jn civic behavior. 
ho would accept the implicit as- 
her whose pupils show gains 
so measure growth in char- 


acter. We suspect that some of them would not 
accept the converse assumption, that a te acher 
pupils have learned to be good c itizens 

would also show significant gains in arithmetic. 
statement of non-ac ademic 


A more modern 
ducation 15, perhaps, to say that the 
yea function in life-adjustment, the de- 


sonality, of social and emotional 
The school should produce well-adjusted, 
Where teacher behavior has 


An exceedingly i 
the teacher who is € 


accumulate 
There are m 
sumption that a teac 
in mathematics will al 


oals of e 
schools ha 
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been the criterion of efficiency, the supposed ef- 
fect of particular acts of the teacher onthe devel- 
opment of character and personality has beenem- 
phasized. Because of the lack of refined mea- 
Sures and because of the time expected to achieve 
noticeable gains toward these o bjectives, they 
have been largely neglected in studies of pupil 
gain. 

In the meantime, Supervisors of practice 
teaching and school administrators appear to op- 
erate on the assumption that an individual who is 
effective in one of the School functions is effective 
in all of them. It is seen by the finding that the 
general over-all rating assigned is as Significant 
as the ratings on particular traits. 

Summarizing to this point— there is a wide- 
Spread assumption that there is a general charac- 
teristic which may be called teaching ability. A 
good teacher is effective in any school, at any 
grade level, with pupils of either sex and of vary- 
ing ability, in all of the subjects in her area of as- 
Signment, academic or non-academic. Or, to put 
it another Way, and perhaps more accurately, it 
is believed that some Characteristics are present 
in all good teachers, wherever they are found. 
One such characteristic may be teaching ability. 
In his factorial analysis, Hellfritzsch (34) identi- 
fied in one situation a fifth factor to which he gave 
that name. He did not isolate itin other tests. 
Hampton (33) could not find such a factor. 

It should be mentioned again thatthe investiga- 
tors were careful not to generalize their findings 
in the ways stated above, but the implications re- 
main. While it seems doubtful that a general 
teaching ability exists, it would be unwise to make 
Such an assertion at the moment. If we accept for 
the sake of argument that there is such a general 
factor of teaching ability, certain other questions 
immediately arise, Discussions of some of them 
will have pertinency even if there be no such gen- 


eral factor. Is it of genetic origin? When can it 
be identified? Is it Subject to training? 


Teaching Ability of Genetic Origin 
— — F —Snetic Origin 


As mentioned above, there are those who as- 
sume that teachers are born. They have a native 
knack for teaching as others dofor mechani cal 
manipulation, scientific inquiry, 
formance. Granted a favorabl 


sible reasons for the lack of higher relationships, 
it may be noted here that in most of the studies 


reviewed in this project, the teachers were from 
the same institution, frequently the University of 
Wisconsin, that they had had work in professional 
education, all were certified teache rs, in most 
instances they were volunteers, and in many in- 
stances (all of those at the University of Wiscon- 
Sin), they were a selected group in terms of aca- 
demic grades. The researches do not reveal what 
results might have been obtained in the classes of 
those who loved to teach (being born to teach), but 
who had had no professional training at all. Such 
a study would be very interesting and might pos- 
Sibly be undertaken by util izing staffs of private 
Schools in which certification is not required. 
Difficult, though not necessarily insurmountable, 
problems of control would be encountered. 


Early Identification 
IM IDenuncauon 


If teaching ability be inherent, and even if itis 
not, but is associated with Specific characteris- 
tics, it might be expected to express itself early. 
Some have stated that they “al ways wanted to 
teach" (9). Some children have been Observed to 
play teacher even before they went to scho ol. 
Students in teacher training courses at the Uni- 
versity of Wisconsin for several years have been 
asked to write autobiographies. In thes e, one 
might anticipate finding statements of early inter- 
ests in teaching. Also, a mass of information a- 
bout the students has been collected on student 
data sheets and the like. These have been includ- 
ed in such questions as “Why did you choose 
teaching as a profession?"' and “What were yous 
reasons for entering the School of Education?’ 
Usually they were not asked ‘‘When did you first 
think that you wanted to teach?” Anal yses of 
these instruments (82, 64) have not shown when 
individuals first showed interest in or aptitude 
for teaching. 

Ringness found that interest inthe subject field 
in which high school teachers later taught appear- 
ed quite early—in the grades—but the decision to 
teach as revealed by the autobiographies did not 
come until the end of high school or even until af- 
ter entering college. That these are true d ates 
may be questioned, however, as the information 
was at no time directly requested. In these days, 
evidence accumulates that not only interest in such 
activities as music, art, dancing, but also that 
interest in science, mathematics, writing and the 
like frequently, if not commonly, may be identi- 
fied at very early ages. Itis by no means im- 
probable that the potentially effective teacher may 
also be detected among very young individuals 
when we learn what to look for, and we should 
certainly expect to do so if teaching be a native 
ability. 


> 
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Prediction Prior to Professional Training 


The elaborate data collected through the auto- 
biographies and on the data booklets is evidence 
of the assumption that the pro spective teacher 
can, to some degree at least, be predicted before 
entering the professional teacher training pro- 
gram. However, Von Haden (82) examined sev- 
eral items from the booklets and the information 
from the autobiographies and found none which 
gave significant relationship to teacher effective- 
ness as measured by pupil gains or pupil evalua- 
tions. Rarely has the candidate for teacher train 
ing been asked to present evidence of interest or 
aptitude for teaching in the application for admis- 
sion. Marks attained incourses are the usual 


criteria. КЕ I 

Frequently, the high s c hool principal is re- 
quested to make an estimate of the probability of 
the student's success in college. He is not asked 
to forecast effectiveness in teaching. Lins Eos 
divided a group of teachers intothose who, =: e 
time of applying for admission to theunive eh y, 
indicated teaching as their first interestan der 
who listed it as the second or third interest. 


reported no differences between these pneum 
to effectiveness. Leila Stevens (14), ning dn 7 
jective technique, investigated the EU а: 
high school students toward teaching as dl e and 
She divided the group into those tar be How- 
those unfavorably inclined toward — pos 
ever, she presents no evidence as to the 
from each group who later entere ere 
profession and therefore, of geri Wien Al- 
mri cols о Ts bel ү {еге were per- 
fred Johnson also tried to lin ho said they 


those W 
sonality differences between \ y 
Were pe to teach and those who did not plan t 


ich of these actually 
do so, but does not show t und be valuable 


did go i is occupation. | ) L 
if es ade act who participated in he — 
could now be located and their success 

With the measures obtained earlier. 


ness 


Consistency of Effective 


t ef- 
Clearly, the purpose of pe Gar is 
ficiency is not so much to v peti is, as it is to 
doing right now, important aŠ ^7. jio do. The 
predict how well she will c0" i n g ability re- 
general assumption is that Ж 
mains fairly constant. eons 
been made of this, and none ove? «terion. Опе, 
time and using pupil gain 29 de T. ib were over 
Brookover (12), showed teachers i 
38 years of age securedlesSeT Sihing of the 
younger teachers. But we ing when they 
gains these teachers were 5 
were, say, 25 years old. 


ecur 


Briggs (14) studied some teachers ten years 
after graduation and concluded that none of the 
earlier ratings correlated with the ratings of 
principals ten years later so as to have a predic- 
tive value greater than chance. Some older 
teachers whose pupils havelesser gains were 
given higher general ratings by both superinten- 
dents and pupils. Possibly had there been mea- 
sures of pupil adjustment, the older ones would 
have shown the greater gains. 


Conditions of Development 


Another question arising from the assumption 
that there is a general ability for teaching is what 
are the conditions for its development. Talent 
does not often “bloom?” without certain favorable 
conditions but, it is commonly held, no amount of 
favorable nurture can producetalent. The best of 
instruction and unending hours of practice will not 
produce a Bernstein from one having no musical 
talent. With talent, training may be effective, al- 
though with high talent, the amount of training 
necessary may be minimal. (There areinstances 
of persons who have been very effective in dealing 
with the ill who had no medical training.) Two 
possible contrasting implications follow. If one 
is a born teacher, all that he needs is to know the 
subject he is teaching, and professional training 
will be valuable to those who possess teaching 
ability. It can do little for those who do not. 

We may have here a key to the inconsistencies 
between professional training, supervisor’s rat- 
ings and pupil gains. Schools of education, main- 
ly, perhaps because they have no way of estimat- 
ing native teaching ability, have admitted to pro- 
fessional training almost anyone of good moral 
character, of reasonably high intelligence and 
satisfactory achievement grades, either in their 
high school or earlier college courses. The im- 
plication is that if one is a good student and/or 
has a fair level of mental ability, he benbe taught 
to be a good teacher. 

It is true that various studies have shown that 
grades in courses and mental ability are asso- 
ciated with pupil gain, but some studies have not 
found this relationship, and usually when it is 
found, it is not very high— not high enough to jus- 
tif employing teachers on these criteria alone. 
Some other factor or factors are evidently operat- 
ing. Professional training may teach individuals 
how to act like teachers without necessarily giving 
them the ability to be teachers, as a medical col- 
lege may inculcate some of the traditional man- 
nerisms of the physician without producing an ex- 
pert diagnostician or surgeon. So it may be eas- 
ier to understand the disagreement bet ween rat- 
ings and gains. The supervisor may be judging 
the way the violinist holds his bow rather than the 
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tone produced. Supervising personnel and > in- 
deed, the general public has built up a stereotype 
of a good teacher. With a little practic e, this 
stereotype can be acquired, on the one hand, and 
recognized and named, on the other hand, thus 
securing some agreement between teacher behav- 
ior and ratings. There remains tobe determined, 


however, the agreement between these ratings and 
pupil change, 


Competency of Raters 
EY OF featers 


The discussion immediately above leads to 
consideration of another assumption that has had 
a major influence in most studies of the effective- 
ness of teaching, viz., that Supervisors, super- 
intendents, principals and board members are 
competent judges of good teaching. And herea- 
gain there is the implication thatthis is a general 
ability requiring little or no tr aining. It is just 
as natural for an observer to know agoodteacher 
When he sees one as it is for the one observed to 
beone. Administrative offi cials recommend 
teachers, hire them, promote them » discharge 
them. But in the training of these persons is 
found very little attention on how to judge effec- 
tiveness. 

One well-known professor of sc hool adminis- 
tration has told this writer that in his classes, the 
question is not considered at all. In none of the 
Studies included in this report in which ratings 
have been employed has there been evidence as to 
the competency of those doing the rating. The 
professional training, the intelligence, the grade 
point average, the personality patterns of those 
rated have been studied extensively; the same 
questions have not been asked ofthose doing the 
rating. These raters are likely to be graduate 
students, professors of education, members of 
state departments, Superintendents, supervisors 
of practice teaching, principals, etc. Some of 
them have been heads of s chools in small com- 
munities and some have not actually worked in a 
classroom for a long time if ever. Many princi- 
pals give little time to Systematically observing 
teaching procedures, examining testing methods, 
and otherwise really evaluating the results of 
teachers’ activities. The judgments of raters are 
frequently based upon personal attractiveness, 
willingness of the teacher to participate in extra- 
curricular activities, her presence in town over 
the week-ends, the frequency with which pupils 
are sent to the office for discipl ine, but not on 
evidence supported by tests of pupil progress. 

In almost all of the studies, ithas been assum- 
ed that a person with a certain title is a compe- 
tent judge. It is amazing that this assumption has 
not been more seriously challenged. Perhaps the 
reason is that in our school systems these per- 


sons are the ones who have the power to make de- 
cisions. The implication follows that the real 
working criterion of teaching success is the p 
ity to secure and to hold a position. Having sal : 
all of this, and in spite of the lack of evidence for 
a general trait which can be called teaching abil- 
ity, supervisors and placement officers seem to 
be confident that they can tell a good teacher when 
they see one. 


General Intelligence 


Granted for the moment, again, that the exis- 
tence of a general factor which can bec alled 
teaching ability is at leasta matter of question, 
are there other possible general characteristics 
which, if not peculiar to, are necessary for, ef- 
fective teaching? One such factor m ay be intel- 
ligence. Several studies, many of them correla- 
tional, have indicated a positive relationship be- 
tween teaching effectiveness and intelligence, al- 
though not all have found this to be true and where 
correlations have been found, they are often low. 
Rostker's (66) results indicated intelligence to be 
an important factor. Hampton (33) found signifi- 
cant relationships in certain situations but not in 
others. Hellfritzsch (34) di scovered with eighth 


grade teachers a factor of “general knowledge and 
mental ability.’ 


Effectiveness Varies Linearly with Intelligence 
— TSS Varies Linearly with Intelligence 


The common assumption has been that intelli- 
gence varies directly with effectiveness and it is 
implied that it is equally influential at all grade 
levels, in all subjects and with all types of pupils. 
None of these implications has been varified. AS 
has been noted above, the teachers of these inves- 
tigations were quite highly selected. While they 
represented rather well a cross-section of teach- 
ers certified through the University of Wisconsin, 
or in a few instances, as in Ha mpton,s, some 
other institution, they were definitely above the 
average, mentally, of the general population. It 
15 not improbable that they were somewhat above 
the average of teachers in general. Whether or 
not these teachers were doing a better job in their 
classes than those trained in other institutions is 
not known. 

It may be that there is a Straightline relation- 
Ship between teaching effectiveness and intelli- 
gence. It is also conceivable that there is amin- 
imum level of intelligence necessary for success 
in teaching under any conditions and that be yond 
this minimum, various possibilities exist. Afur- 
ther increase in intelligence may not affect teach- 
ing effectiveness at all, or indec reasing or in- 
creasing degrees. In some Occupations, for ex- 
ample, a certain visual acuity is required but a 
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t associated with better per- 
sible thatthe amount of intel- 
ng depends upon 


greater acuity is no 
formance. It is pos 
ligence required for good teac hi 
circumstances. 

The assumption that intelligence is directly re- 
lated to teaching efficiency implies that the same 
amount of intelligence is required to be success- 
ful in the first grade as in the seve nth grade or 
in the twelfth grade. Is it? Apparently the level 
of intelligence necessary to learn the material of 
the third grade is less than that needed to learn 
the subject matter of the eighth. The intelligence 
necessary to successful graduation from high 
School is greater than that one must have to finish 
the eighth grade. Are there similar differences 
in the intelligence needed to teach the subj ect 
matter of these grades? Is the mental ability ne- 
cessary for effective teaching of arithmetic the 
same as that for teaching spelling or civics? Or, 
may there be differences in the mental equipment 


for the teaching of advanced algebra and the teach- 
ing of manual training or music? And is the suc- 
cessful teacher of those of IQ's of 70 necessarily 
of the same intelligence 29 the one whose pupils 
2 

ions is that the teacher 
bject matter tobe taught 
stand the children of 
her classes and tl tanding штер 
of whatever type and i r class they may 
be demands similar de af inte ee hypo" 
d isis true? AP - 

о we know that this 15 es and of low- 


thesis is that children O 
er abilities are less complex or E А 
those who are older or have hig 
teacher of the older should unde rstand not only 
t understand how 


t i the moment bu 
ER That is, She should be under- 


ildren. 

Standi ounger and older childre 
ено E pae ee di nces in mental ability 
e rs may be expected 


A reply to these quest 


required of different teache n 
s en chargedin the pas 
and desirable. Tt hue т normal sc hools and 


that teachers prepared in 
teachers we pets for the elementary grades me 
been of less mental abili than those prepared in 
i . Per 
universities for the high 1 grades p 


that is the way it should be- e 
The above hypothesis may norbe pee "hes 
among certain educational groupe? sistance but 
concerning it may encoun e а investiga to r, 
it would be well to explore ж. Оз i intelligence 
Rolfe (65) has already indicated tha 
is more highly correlated Wi = 
eighth ae EES when the teacher teaches on 
y that grade than in those in у ching 
t en aPP roa 
aches all of the grades. bea of course, be re- 


Such an investigation, it sh i 
el of intellige 


membered that the lev 
ance. 


sential relationship to impor 


higher score on a conventional 

igl test of mental a- 

bility to secure an A in philosophy than to ome A 

ñ in dietetics— but a poor diet may be a major in 
uence on the kind of philosophy prod ° 

ае phy produced by the 


Kinds of Intelligence 


There is also the question of kinds of intelli- 
gence. The common use in these studies of the 
Henmon-Nelson or the ACE test implies a theor 
of general intelligence. A logical thesis is that 4 
test of primary abilities might reveal an associa- 
tion of verbal ability with success as a social sci- 
ence teacher, while a numerical factor might 
have greater relationship with effectiveness in 
mathematics, and a spatial factor in the teachin, 
of manual arts. If there be such athing as € 
intelligence, it may be of Special importance ei- 
ther in the development of pupil adjustment or at 
least in the securing and holding of a job. The 
low relationships and the inconsistencies found 
between intelligence test scores and pupil gains 
may be due to differences inthe amounts or kinds 
of intelligence requisite for effectiveness in the 
various subjects. Ronald Jones (42), for example 
sought to determine the correlations between in- 
telligence and pupil gains in 14 high school sub- 
jects, but the design was not such as to make the 
comparison subject by subject. Evidence upon 
this subject might help determine not only the 
placing of teachers but also such questions as the 
departmentalizing of instruction, homogeneous 
grouping and team instruction. 


General Knowledge 


An assumption commonly held is that gene ral 
knowledge, and especially knowledge in one's own 
field, is related to teaching effectiveness. Hamp- 
ton (33) found a general knowledge-mental abilit 
factor in successful high school teachers. Ronald 
Jones (42) found no significant relationships be- 
tween effectiveness and university grades or rat- 
ings. Inconsistent results among studies are the 
rule. Even marks in one’s major subject have 
not always proved to be good predictive criteria 
It has been implied that one who knows his subject 
in general, or one who has a wide general know- 
ledge, is competent in the specific areabeing 
measured. The “it stands to reason’’ argument 
supports this implication. If a person knows cal- 
culus, he must understand long division. If he 
has high grades in an English major, he should 
be able to teach spelling and grammar as well as 
short story writing or the appreciation of poetry 
If the major is in social studies, the teac hier 
should be competent in history of any country, ge 
ography, or a unit on public health. Uem 
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The relationship between grade point averages 
and successful teaching has been usually found to 
be positive, but too low for individual prediction. 
However, a grade point average is a composite of 
scores in a variety of courses and even a record 
of straight A’s is not a guarentee of excellence in 
every phase of a subject. Much of the material 
studied in a student’s major is very different 
from the units taught inelementary or high school 
classes. It is not unlikely that the findings of 
Ronald Jones and others that high school averages 
were more closely related to teaching effective- 
ness in high school subjects than were college av- 
erages is because these high school teachers were 


teaching the things which they learned in high 
school. 


Linearity 


Just as it is conceivable that beyond a certain 
point, an increase of intelligence is not accom- 
panied by an increase in effectiveness, so it is 
possible that an increase in knowledge beyonda 
certain amount is of little significance. There 
are those who believe, without, so far as we 
know, any supporting or negating evidence, that 
an individual may know too much to be a good 
teacher of children at certain levels. Not only is 
a college major in mathematics not necessary to 
do an effective job of teaching arithmetic at the 
third grade level, is the argument, but it may ac- 
tually get in the way of good teaching. Or, it may 
be that the teacher who has very extended know- 
ledge of a field will find it difficult with those at 
the beginning levels patiently to limit himself to 
the process through which thelearners at this 
point are going. The argument will not appear 


reasonable to some, but perhaps it should not be 
rejected without consideration. 


Professional Training 


Training Required 


A very common assumption among profession- 
al educators has been that professional trai ning 
is needed in order for one to become an effective 
teacher. It has been rather generally agreed that 
this training should include knowledge of the field 
to be taught, knowledge of thel earning process, 
an understanding of children and practice teach- 
ing. Other areas, such as the history and phil- 
osophy of education, and the knowledge of how to 
construct and use devices to measure the results 
of instruction are also frequently required. Just 
as it has been implied that if one knows his sub- 
ject, he can teach it, so it is implied that if one 
knows about children, he can teach them; that if 
he knows about the psychology of learning, he can 


choose the best ways of teaching. 


Ability to Evaluate Progress Implied by Ability 
to Teach 


Especially it has been implied that if one can 
teach, he can measure the results of teaching. 
This latter implication is of very doubtful validi- 
ty, and it is surprising that although teachers as- 
sign grades, recommend promotions and label 
pupils as high or low in scholarship gene rally, 
little training in testing has been included in many 
teacher training programs, and rating scales and 
schedules for observing teacher behavior contain 
almost no recognition of this function. Whereas, 
too, testing is not only a measure of progress, 
but is an integral part of the learning process, 
this is a serious oversight. 


Professional Courses 


Studies have been disappointing in that no close 
relationships are usually found between grades in 
particular professional courses or between com- 
posite grades in these courses and teaching effec- 
tiveness. Correlations have been higher between 
grades in practice teaching and ratings of super- 
visors or superintendents than have been the cor- 
relations between professional courses in educa- 
tion and these ratings. This may be because SU- 
pervisors and superintendents were looking more 
at the personal characteristics of teachers than 
at pupil progress, or it may be that the concepts 
taught in the professional courses have not been 
transferring directly to classroom practice B. 
There is another possibility. Lange (47) sough 
to find the relationships between knowledge © 
specific concepts taught in certain profes sion a 
courses and pupil gain. 


Similar Works and Courses Imply Same Concepts 


There is an assumption that those who have 
had professional courses of the same title have 
had the same training in that area in whatever 
state or institution these courses are given. This 
assumption is seen in the ce rtification require- 
ments of the various states, many of which 7 
quire courses by title. In Lange’s study (47), al 
of the teachers had taken their professional WOT 
at the University of Wisconsin, so it might be 225 
pected that all who had had the same courses ha 
acquired the same concepts. Several sections of 
the basic course investigated by Lange are given 
at the University of Wisconsin and are taught by 
different instructors. It was found that in many 
instances the instructors did not agree. It could 
hardly be expected that the re would be a signifi- 
cant relationship between concepts presented in a 
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course and teacher effectiveness if the concepts 
were given one meaning in one section and anoth- 
er meaning in another section. If all of the 
teachers had developed their understandings un- 
der the same instructor, a relationship might 
have been found—though whether the correlation 
would be positive or negative might depend upon 
which instructor it was. Barr has pointe d out 
that many terms are used to denote the same 
characteristics or behaviors. It is here empha- 
sized that the same words may convey many 
meanings. An investigation со nducted among 


teachers from a smaller institution where all did 


have their professional work under a single in- 


structor might be of interest. 
Teacher Behaviors 


Those who direct professional training of 
teachers and those who build rating scales are 
likely to assume that there are certain charac- 


teristics of teacher behavior which result in the 
effective learning of pupils. Thisis based on the 
prior assumption that there is a specific Way in 
Which learning goes on and that she whose be- 
havior is most suited to this learning processis, 
Of course, the most effective teacher. It follows, 
too, that there is a basic method— lear ning by 
rote or the method of discovery, for example, 
for all areas— the acquisition of academic know- 
ledge, manual skills, the ability to solve prob- 
lems or the development of citizenship. Itis 
recognized, of course, that there may be varia- 


tions i “cation of the method. Subtrac - 
€ tne sm: r bor rowing method 


tio i n a itive O < 
A E edid ер he above assumption, 


can be taught by rote. Ont ° 
Schemes of observing teacher behavior have been 


employed. Notes may pe made of the T i 
talking done by the pupils and by the teacher, = 
number and types of questions asked, п, som 
ments upon pupils’ res the num ades 
kinds of aids which ar ed, the techniq e 
€mployed to maintain O the classroom. 
here there is agreement among 
as to the interpretation to be 8? 
elements of teacher behav" 


ie eee making and не achers have 
ions quite consistent ratings s. obtained. Ob- 


een frequently, but not always, 
Viously, the value of the technique 0f vidence 
teacher behavior is dependent Ч n 
that this particular bit of behavior Penis effect 
have this effect upon the pupil and hal 
Will result in the desired learning. Ji sm 

ese points is scanty and agreemen  alassent 
Servers of teachers may mean hology of edu- 
to а particular philosophy OF psych 
ree Are we sure thatthe same q;gferent 

T behavior is equally effective 


learning situations and are we sure which theory 
of learning is the better to follow at the moment? 
If a teacher who was nurtured in the Thorndikian 
S-R hypothesis is observed by an enthusiastic 
follower of field theory, how will she be rated? 


Rating Scales 


It is surprising how little att ention has been 
given on teacher rating scales andon observation 
records to actual methods of teaching and the di- 
rection of learning. Rather, the observer usual- 
ly notes personality characteristics, ifthe teach- 
er is alert, if she appears enthusiastic and co- 
operative, if she seems to be interested in the 
children, if she has good discipline, if she is 
forceful and the like. Ratings may estimate the 
teacher's knowledge ofthe subject, her profes- 
sional attitudes, whether she has provided sup- 
plementary materials and perhaps whether she 
demands good performance from the pupils. 
Sometimes it is noted if she makes adjustments 
to individual differences, but rarely is there a 
record of what specific adjustments are made. 
There is, to be sure, no way by whichthe observ- 
er, on no more than one or two occ asions, can 
measure the adequacy of adjustment to the indi- 
vidual child. In order to make a rating, he would 
have to know the characteristics of the pupil, his 
previous performances, his present stage in the 


learning process, andsoon. Inthe meantime, 
the observer gives a plus value on the chart to 
adjusting for individual differences and a minus 
value for giving more attention to one child than 
to another, but perhaps relatingto the same 
teacher behavior. 
There are few ratings found on t ho se behav- 
iors which relate toteaching and learning as such. 
What did the teacher dotodevelopa specific con- 
cept? How did the pupils respond to this presen- 
tation? What was the next step? How and when 
were errors detected, and what was done to elim- 
inate them? The assumption has seemed to be 
that if the teacher has a friendly personality and 
respects the personality of the pupiland that if 
she is active, enthusiastic and in good standing 
with the others of the school personnel and in the 
community, then she is an effective teacher. 


Training in Making Observations 


It has been noted that those who obser ve and 
rate teacher behavior can be trained so as to se- 
cure a high degree of consistency and agreement. 
This is to be expected when they have agreed be- 
forehand to judge a teacher who sits at her desk 
a good deal as passive, andone who moves 
around a lot as active, one who gives much help 
to a child as partial, and the one who asks the 
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same number of questions of eachchildas impar- 
tial, and so оп. To judge whetheror nota teach- 
er is helping a child according to his need is an- 
other question and requires more information for 


its answer than is usually obtained by the observ- 
er. 


Observation of Teaching Behavior 


Jayne (37) did try to get at some of the items 
of teacher behavior which at least possibly might 
be rather directly related to the learning of pupils. 
He found no relationship between the amount the 
teacher talked and pupil gain. He did not analyze 
the talk to identify the learning method which 
might be involved. He further investigated gain 
and retention in terms of amount and spacing of 
teacher participation, the number and kindsof 
questions asked— whether fact or t ho ught ques- 
tions. The relationships between kinds of ques- 
tions and gain seemed to vary with circumstances 
as did the value of critical comments by the 
teacher. There was speculation that thekind of 
questions appropriate to one purpose might not be 
suitable to another whichagain suggests that there 
is no one method of teaching or learning appli- 
cable alike to all areas andlevels of achievement. 
Jayne found no specific teacher activity signifi- 
cantly associated with pupil gain. 


Personality of Teachers 


It has been mentioned earlier that rating 
Scales and systematic observations of teacher be- 
havior have given much attention to personality 
traits. This is no doubt a result of the empha- 
sis in modern schools upon “the whole child.” 
To test the assumption that there are certain as- 
pects of personality associated with effective 
teaching instruments, such as temperament 
Scales, personality scales, measures of neurotic 
behavior and the like have been used. Studies of 
individual traits and composites of traits have 
been reported (46, 57, 41). Some of these have 
been subjected to factorialanalysis. These traits 
of teacher personality have been relatedto super- 
visors rating or to pupil gains in academic sub- 
jects or in what might be called academic atti- 
tudes. That is, personality factors of teachers 
have been compared with pupil gain in, for exam- 
ple, knowledge about public health and with their 
attitudes toward public health or with their civic 
beliefs. There has been little attempt to relate 
the teacher's personality withchanges in the per- 
sonality of the pupils. 

Once more the implicationis that these per- 
sonal characteristics of the teacher which are 
favorable to development in academic knowledge 
are also favorable to growth in per sonal adjust- 
ment, or vice versa. And there is also the im- 


plication that the same pattern of traits is ap- 
propriate for all pupils at all levels of learning. 
Another paper of this report tells of the attempt 
to discover some characteristic or composite of 
characteristics which is present in all good 
teachers and absent in poor ones, or some factor 
present in poor teachers but absent in good ones. 
The results seem to be inconclusive. One study 
found that considerateness, although highly rated 
by supervisors and pupils, was negatively corre- 
lated (though not significantly so) with pupilgain. 
Indeed, no specific trait or com posite oftraits 
has been found which is inevitably associated with 
teaching effectiveness. These studies have not 
attempted to find if there be patterns of personal- 
ality traits of teachers es pecially effective with 
pupils who, too, present particular patterns of 
personality. It is a perfectly good hypothesis that 
the permissive teacher will get good results with 
one type of pupil, while the rigid disciplinarian 
will succeed much better with another type. d 
very forceful, active teacher may be well adapte 
to a class of very bright children and not so wel 
adapted to dull children. The lack of studies con- 
cerning the relation ofteacher traits to personal- 
ity development of children is probably due to et 
lack of good instruments for measuring вше à 
growth and to the fact that changes in personality 
are likely to come slowly and cannot be adequate- 
ly evaluated in the time available for the investi- 
gations. ion 
Studies of teacher personality and observatio 
of the behavior of successful and unsuc c e $$ e 
teachers are, of course, of real value and su 5 
stantial progress in the understanding of tate. 
in effectiveness has resulted from them. m 
mately, they must be related to change in рур У 
in some aspect of learning for which the scho 
has accepted responsibility. s 
Teachers deal with groups of children, КОШ 
which are heterogeneous along s everald ope ds 
Sions. If some characteristics or some met e p 
Seem to be associated with good results wit S 
considerable proportion ofthe group, and ma bs 
the studies reviewed in this monograph have i" 
vised ingenious and rewarding techniques for will 
discovery of these, then the superior teacher te 
be the one who possesses enough of these 1915 
the larger number of pupils npe im а 
As the numbers of children warrant io Stres a 
may be divided according to the a charac- 
pupils, and teachers assigned whose dren. At 
teristics are appropriate for these © То beach: 
the moment, it may be desirable to pen y Ee 
ers with different patterns of personality, ler. 
ent degrees of intelligence and so on for different 
pede, and different fields of subject matter on 
the chance that each child will encou nt er some 
teacher whose specifications W illfithis. In the 
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meantime the search will goon for the discovery 
of factors of general significance. 


Special Characteristics 


Speech 


there have been as- 
portance to teacher 
al characteristics. 
commonly be- 


At one time or another, 
sumptions concerning the im 
effectiveness of certain speci 
One of these is speech. Itis SO 
lieved that teachers must possess good speech 


that many schools of education require prospec- 

t andto receive 
special training in speech if certain defects ap- 
pear. It is believed that both good and bad 
Speech qualities are imita 


the teacher should present а £ : 
ritating and so in- 


certain qualities of voice areir 

terfere with learning, and that, of co" rse, the 

Speech be intelligible. z " 
lationships 


McCoard (55) did find significant re 
ibn ss of speech, but not 


between general effectivene ) 
between any one element of s pe ® ch, and pupil 
gain, although the correlation w a S not high e- 
nough to justify its use as an index of teaching a- 
bility. On the other hand, Jayne’s study yielded 
a correlation of -. 09 between $ peech and pupil 


gain. Neither of the investigations attempted to 
establish a cut-off point in speech proficiency be- 
low which the teacher would surely be ineffective. 
Perhaps here again We have a factor important e 
a certain degree but unrelated to success beyon 


that point. 


The ability to maintain discip 


among the desirable traits of а 1 
Бу вирегі DP rincipa]s. The lack 0 
د‎ ar ү the cause of alarge 


this ability appears to be 
Proportion oi teacher f 1 18 assumed 
that learning is more efficient in а 
Classroom. It is also One of the 
character is developed. 1 15 imp 
Class of the teacher being observed 
tif the teach send 

here is ood disci- 
erthat the teacher who 


situation will be 
one Yet 


but is overwhelmed by sevent e. Atone 
ti Styles concerning discipline © p a fer- 
ime the rigid taskmaster Who ruled w of them 
rule— whose pupils, be there only three fal time 
must “rise, turn, ana pass” at dis™ iss 


was considered to be a good teacher. 

few years, there has been a tendency i Е tee 
the permissive teacher. The noisy Vds = < 
not condemned but commended if it be ће noi A 
of industry." Presently, there may be SERDE 
of a return toward stricter behavior requirement s 
One of the very likely reasons for ا‎ 
between raters and between ratings and pu 15 
gains is the difference in attitudes toward e 
room management. Ifthe superintendent is a dis- 
ciplinarian and the classroom te ac her has been 
trained in a philosophy of permissiveness, the 
teacher is likely to get a low rating, not only on 
discipline, but because of the halo effect, on her 
general effectiveness. I 


Other Special Considerations 


Conformity to Local Standards 


Various other special considerations are as- 
sumed to affect the teacher'ssuccess. Oneteach- 
er is rated negatively (14) because she went home 
nearly every week-end. A teacher is not a good 
one unless she participates in community affairs 
— but of course in only certain affairs. What ef- 
fect these things have on pu pil gains or on pupil 
adjustment is uncertain. А rural individual (28) 
14), is taking a heavy chance if she undertakes to 
teach in an urban community— which perhaps ac- 
counts for so much ineffective college tea c hing. 
A mature person may not succeed wellinan ‘‘im- 
mature" community. Even per sonal attractive- 
ness may be à hazard if the ideal is to make 
teaching a permanent oc cu pation—‘‘It appears 
that the more attractive teachers left the profes- 
sion sooner than the less attractive ones. '' (14) 
While all of the above assumptions are undoubted- 
ly based upon some observations and known prac- 
tices, the objective e vidence to support them is 
not abundant. And sometimes contrary assump- 
tions are met. Not concerned that a rural girl 
may not fit into a city school, many superinten- 
dents not only ask that their candidates have ex- 
perience, but are perfectly willing to accept those 
who have had that experience in rural schools — 
on the assumption, apparently, that if one is a 
good teacher in one situation, she will be good in 
any situation. 

Similarly, in one community, ‘‘father-being-a 
farmer" had a positive correlation with ratings 
as a teacher, while in another community, it was 
not a significant factor. To have been engaged in 
athletic or musical activities seems to be an im- 
portant consideration in the ratings Secured in 
some places. In others, these factors have no 
relationship whatever. Perhaps the assum ption 
can be justified that to be effective, the teacher's 


characteristics need to match the require ments 
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of a particular superintendent or a particular 
community. Special factors, such as those dis- 
cussed here, are probably of less moment in lar- 
ger communities than in smaller ones, but they 
are not absent. One superintendent of a quite 
large city school is knownto have stated that tall, 
slender women are better teachers than short, 
chubby ones. Although the effect of such matters 
on pupil gains is lacking, itis still good policy to 
try to place a teacher in terms of, among other 
things, the information at hand concern ing the 
local school and community. A state officer who 
had rated a teacher low, although the superinten- 
dent had rated her much higher, said that if the 
superintendent himself had beenmore competent, 
he too would have given a low rating. It is pos- 
sible, however, that a teacher who would have 
won the commendation of the state officer might 
have been out of place with that particular super- 
intendent, suggesting further that teaching effec- 
tiveness is a matter of many interrelated factors. 


Health 


It is assumed that physical health and freedom 
from physical defects are associated with teach- 
ing effectiveness. Examinations whose purposes 
are to protect pupils from infections lie outside 
of the present discussion. But beyond these, it 
is difficult for a person who has a noticeable de- 
fect, other than that evidenced by not too thick 
lenses, to secure a teaching position. Teaching 
forcefulness and apparent supply of physical en- 
ergy are often judged to be associated. There is 
little evidence on this matter or on the degree of 
physical defect which can be tolerated before a 
reduction of effectiveness appears. 

Similarly, the degree of mental health neces- 
sary for efficiency, either generally or in par- 
ticular situations, has not been established. 


Use of Aids 


It is assumed that a teacher will make use of 
various available materials and aids to instruc- 
tion, and it is often assumed further that if ma- 
terials are not Supplied, somehow she will pro- 
vide them, Or it may beassum ed that a good 
teacher will not need these su pplementary sup- 
plies. The little evidence that there is, however, 
is that those schools which have the more abun- 
dant facilities seem to be producing the better 
results. These studies here reported have not 
indicated what instructional aids were at hand for 
the teachers to use. 


Philosophy 


Differences in philosophy present a serious 
danger in estimating the efficiency of teachers 


through rating scales and especially through the 
records of observed behavior. The scales orre- 
cord blanks were devised interms ofa particular 
philosophy. If the observersare trained so as to 
achieve reliability, it means that they have agreed 
that a certain behavior indicates a certain char- 
acteristic and, further, that this characteristic is 
desirable or undesirable. These decisions may 
not be assented to by those holding a differe nt 
philosophy. Obviously, when these observations 
are made of a teacher who has adifferent philos- 
ophy, the rating will tend to be low. In the ab- 
sence of objective effects upon pupils, such rat- 
ings should be viewed with caution. 

It may be interesting to illustrate differences 
in evaulation of a teacher as a result of differing 
criteria. Miss К, as reported by Briggs(14) 
was one of 14 out of aclass of 58 who were grad- 
uated from the University of Wisconsin and who 
were still teaching ten years later. In her first 
position, which was for one year, she was rated 
by her superintendent as “average”. During her 
Second year, she taught part-time in each of two 
Schools. One of her principals was said to be 
“very complimentary" about her work and 
“would have liked to retain her permanently. 
The other principal was also ‘‘enthusiastic. ’? The 
third position was for one year and no information 
about her success there was available. At the 
time of the investigation, she had been in her е 
present position for seven years. The principa 
rated her “good average. ’? Among her assets a9 
listed were: good knowledge of her subject, car- 
ried out assignments well, took an interest іп pu- 
pils, maintained fairly good order in her classes 
without using repressive measures, good healt ё 
has traveled extensively. Interviews with her PU 
pils indicated that she was interested in them, 
permitted them considerable freedom in art Re 
Ses, appeared to be wellliked by them. The staf 
considered her competent in her field. The princi- 
pal always knew where she stood. š 

Reading thus far, some will probably see "a 
Miss K a fairly good teacher. But MissK is list- 
ed, too, as having some liabilities. Tothe ор 
Server, she seemed self-satisfied. She was ''nO! 
too ready to over-do— possibly lazy.’’ She was 
unable or unwilling to analyze herself, lacked m 
thusiasm, did not have a friendly manner, e. 
not too generous with her talents, seldom Lar 
teered suggestions for plays, musicals, etc. ‘4 no 
School programs, went home week-ends, h@ iot 
part in the social life of the community, had not 
prepared any special exhibit of the pupil's e; 
Work, had taken only two or three professiona 
Courses since beginning to teach. 

The mere fact that Miss K hadtaughtten years 
and was rated average or above by her principals 
is not, of course, proof that she was agood teach- 
er. However, some who examine her record and 
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note that most of the liabilities were the impres- 
sions listed by one who had hadone interview with 
the teacher and had observed one of her classes 
for part of one class period would still be inclin- 
ed to rate her as successful. 

While no specific evidence is given, there is 
implication in the record that as an undergradu- 
ate Miss K had rather low grades although there 
was ''apparently reasonable suc cess in practice 
teaching. '" She was willing to work but was satis- 
fied with inferior work. She was immature but 
willing to accept responsibilities. This was not 
an excellent record, but not by any means a fail- 
ing one. 

The final evaluation of Miss K was: “Miss K's 
case was a rather obvious one of impro per oc- 
cupational choice. Had the case history been 
compiled and presented at the time she applied 
for admission to the School of Education,it is Very 


unlikely that any committee would have approvat 
her application. ere seems to have een suf- 
pplication. Ther hat time, hadit been 


ficient evidence available at t с 
assembled in case study form, to have indicate 
that she would be a very doubtful risk as a teach- 


er." The neutral observer finds it difficult to 
understand this devastatingly negative report. 
Until the criteria of success are more objective, 
there will be little likelihood of finding those 
characteristics which measure teaching effec- 
tiveness. 


Motivation 
Dav 


Teacher's Motivation on 
Th i 
ere is agreement that an under standing of 


motivation is necessary to an 
ation of any effective performance, although only 


in recent years has this subject been the nee 
systematic research. With rE irem am 
effectiveness, there are two pr actica ien ana 
One relates to the teacher: Why do > The oth- 
Choose to enter the teaching ро енн kul аге 
er relates to the pupils: How gn "i to want to 
teachers in influencing their pu pi í Š 
earn? " i o 
Ringness (64) has presented in ge um idera- 
a review of some of the theoretica summarized 
tions relating to motivation an has he choice of 
his study of the motives un А 
teaching as а career. Ап assump" o effective- 
the reason for the choice 18 related IP “дв Ring- 
ness as a teacher. It is not surprising, that they 
ness pointed out, that those who 257 q who eu- 
teach from a desire to be of servio o their prin- 
logize the profession are acceptable Mivel few 
ciples, nor is it surprising that r oe work be- 
teachers would admit that they chose t snap and 
Cause the professional courses ея 


nograph 


the profession was easy to getinto. Not included 
in Ringness’ list of motives, thoughthey were rec- 
ommended in a Study by Best (9) whichthe teach- 
ers checked, were “liking to teach’’ as such nor 
“Jove of children or young people." These are 
rather vague values, to be sure, but perhaps no 
more so thanthe “welfare of society. ’’ In any e- 
vent, the assumption that one whoteaches from a 
desire to promote learning secures higher pupil 
gains or better development of character than 
does the one who is motivated to do a good job in 
order to be promoted or in order to get funds to 
do something other than tea c hing has not as yet 
been conclusively proven. This isanarea in 
which further research is much to be desired. 


Pupils' Motivation 


Another assumption is that the teacher who is 
able to present her subject in su ch a way that 
learning can easily be accomplished is also one 
who can persuade her pupils not only to want to 
learn it, but more than that, to wish to continue 
learning. For, in the last analysis, the criterion 
of effective learning isthe creation inthe individ- 
ual of a desire to learn more. A goal of educa- 
tion limited to the learningof merely what is pre- 
sented in the classroom wo uld surely be a low 
one. 
Little attention has been given in these studies 
to judging teaching effectiveness on the basis of 
engendering in pupils a desire to learn. Indeed, 
in several of the researches, attempts have been 
made to control motivation by selecting po pula- 
tions from similar socio-economic backgrounds, 
thus possibly eliminating an essential factor of 
the function to be measured. Whether or nota 
different set of teacher characteristics is needed 
for working with those pupils who are already ea- 
ger to learn than is requiredfor those whose ed- 
ucational aspirations are very lowis another sub- 
ject for research. One hypothesis might be that 
the teacher who has elected to teach because of 
his own interest in a particular subject- matter 
field and the opportunity teaching willgive him to 
continue his study in that field will be more suc- 
cessful with those who have already learned to 
like to learn, while the teacher w ho has entered 
the profession from a desire to serve humanity 
will be more effective with those who have not yet 
developed any enthusiasm for the intellectual life. 
Perhaps a third set of motivations is desirable 
for the teacher of those whose interest is definite- 
ly directed toward the acquisition of only occupa- 
tional skills. It would appear, too, that occa- 
sionally a self-motivated individual appears for 
whom the most effective leader behavior is to get 


out of his way. 
The discussion of this paper has emphasized 
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that there are a multitude of assumptions and im- 
plications inherent in the problem of understand- 
ing the characteristics of effective teaching. The 
role of the teacher is a highly complex one. 
Many and conflicting pressures are at work which 
influence teacher and pupil be havior and which 
determine to various degrees success in teaching. 
Many aspects of the problem have been intensive- 
ly and ingeniously attacked in the researches re- 
ported in this volume. Many other aspects re- 
main to be explored. It seems incr easingly 
doubtful that any single charac teristic ofthe 
teacher herself, her training or herbehavior, 
will be indicative of her effectiveness. It is 
probable that complex int errelationships among 
the teacher, the pupils, the school administration 
and the community are at work. Different com- 
binations of the same elements yield substances 
having very different properties. Different com- 
binations of teacher characteristics almost cer- 
tainly will be found to be important for maximum 
effectiveness in different situations. The next 
step in research may well be to try to discover 
what these interrelationships may be. 


Summary 


All investigations into, and discussions of, 
teaching effectiveness are based upon assump- 
tions. Some of these have been stated explicitly 
by those doing the research heresummarized. 
Many more of them have been only implied, some 
probably not brought to the level of consciousness. 
Not all of the assumptions are present in every 
piece of research. Some are incompatible with 
others. Some particular ones appear under more 
than one general assumption. All, and undoubt- 
edly others not mentioned here, will eventu ally 
require consideration. Following are assump- 
tions, stated or implied, in some one or more of 
the studies reviewed in the present volume: 

1. There is a general teaching ability—a talent 
for teaching. It is thesame for each sex. It 
is effective at all grade levels, with all types 
of pupils— bright, dull, secure, insecure, 
etc. ; іп all communities, in all areas of 
learning— academic, social and moral. It is 
of genetic origin. It canbe recognized early. 
It is constant. It can be recognized by ob- 
serving teacher behavior. It can be identi- 
fied by measuring certain teacher or pupil 
performances toward particular goals of the 


school, Training programs, though having. 


some value in its development, cannot cre- 
ate it. 

2. Teaching ability is a result of training. 
Knowledge of the subject matter is sufficient 
training. Professional training is essential: 
This to include understanding of the individ- 
ual taught and his development— physical, 


mental, social; the under standing of the 
learning processes; appropriate methods of 
teaching and classroom management; meth- 
ods of evaluating progress inlearning; prac- 
tice teaching, and perhaps the pur po ses of 
American education. 

Words used in professional courses havethe 
same meaning for instructorsand convey the 
same meaning to students. 

Teaching ability can be objectively measured 
by the means of pupil gains in academic sub- 
jects, personality, and character. 

Teaching ability can be objectively evaluated 
by trained observers of teacher activities 
such as amount of talking by teachers, num- 
ber of questions asked of students, impar- 
tiality, caring for individual differences, ap- 
parent energy. 

Subjective evaluation of teaching performance 
has considerable validity. 

Teaching effectiveness canbe adequately rat- 
ed by supervisors, superintendents, princi- 
pals, subject-matter specialists. 

Ratings given teachers are independent of the 
philosophies of those pre paring the rating 
scales. 

Certain personality characteristics or pat- 
terns of characteristics are essential to ad 
fective teaching. These are the same for -r 
ages, all types of pupils and all types ° 
learning. Certain characteristics are effec- 
tive in certain situations and other character- 
istics in other situations. 

Intelligence is directly related to teaching ef- 
fectiveness. This refers to general intelli- 
gence. Certain of the primary mental abili- 
ties are important, depending upon the situr 
tion. Effectiveness may depend upon specia 
abilities. 

Effectiveness is determined by motivation of 
the teacher. Some types of motives result in 
greater success than do others. 

Effectiveness of teaching is determined by the 
motivation of pupils. " 

The teacher can be of major influence in mo- 
tivating pupils. 

Certain special conditions are related 2 
fective teaching, such as that permissive € 
Cipline produces the better results; that hê 
discipline produces the better results; ihe 
Speech of the teacher affects learning; th? that 
health of the teacher affects lear nins: o 
Socio-economic status affects learning; to 
effectiveness is determined by conformity 
local standards. 

Teaching effectiveness is a matter of an al- 
most infinite number of interrelationships a- 
mong teachers, pupils, adm inistrative per- 
sonnel, colleagues, the community, influenc- 
ed by inherent talent and professional train- 
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ing so that at best, perhaps, identification of 

individuals with some very high ability or 
several average abilities and no completely 
negative one is all that can be hoped for. 

16. The statistical techniques employed have been 
adequate to isolate the factors determining 
effectiveness, that linearity exists between 
effectiveness and such factors as intelligence, 
knowledge, health, emotional stability. 

17. The characteristics displayed in lim ited and 
highly controlled situations are descriptive 
of those which will function similarly in other 
and more ‘‘natural’’ conditions. Techniques 
employed in research are applicable ina 


field situation. : 

18. Equal gains in various 5 C hool subjects, as 
measured by standard score techniques, rep- 
resent truly equal degrees of growth. 

19. Traits found to be characteristics of goo dor 
poor teachers as à group exist in individuals 
who are good or poor. Е 

20. The performance of a teacher W hen partici- 
pating in a research pro m 1s representa 
tive of her customary or best performance. 

21. The influence of such factors as home and 


community aspirations, previous тепаа 
influences and t 


different schools С 
22. The philosophies of 
underlying the r 
struction of measu? 
evaluation of Laer an 
mon to those involve“ cud ея 
Obviously, not all of the assumptions In ine 
vestigations here summarized are included in 
list. Many of the as i mentioned have 
ry investigated in tl m ches re viewe 
is monograph. Althoug n 
Sults Raya Been inconclusive, much progress has 
been made in the qetermination є 
teaching effectiveness. There are still a € 
be explorec. 


i ining to 
number of assumptions remaining pren 
Practically a the studies have been limi 


suring ins 
is acc 


ed ones, Data have been 88, ered ner bn 
Specific procedures, r efinite | gem s D 
particular educational levels and have 
preted according to standards agree 
purposes of the investigation. , Many 
5 have been in terms 0 pio 
y or of teacher behavior E T 
ential in promoting academic rowthor perse, 
ity development. Few have attempte 


both academic and personality growth — to sa; 
nothing of morality or civic behavior. No dd 
has undertaken to evaluate the effectiveness a 
the teacher on the educational effort as a whole— 
growth academically, in personality, in charac- 
ter, in the desire to continue learning, inthe 
teacher’s personal traits and abilities as interre 
lated with the traits and abilities of the сава 
in groups and as individuals, in terms of those of 
differing levels of mentality or ac hievement, i 
schools differently equipped, in comm unities 
differing socio-economic stati and educational as- 
pirations operating under different educational 
philosophies. 

It is possible that ratings of principalsand 
superintendents come nearer than research in- 
vestigations or the observations of teachers ac- 
cording to specified schedules to being evalua- 
tions of the teacher's function as a whole. The 
rating official may see the teacher in light of the 
entire educational situation rather than in terms 
of a particular child, a certain class, a specific 
subject or a definite event. The overall rating 
should, possibly. be the best one. But the situa- 
tion is not ideal. Rating officials have not been 
trained in the process of rating. They have not 
learned for what specific things tolook. They 
never have the opportunity to judge a teacher ad- 
equately with respect to many of the essential 
conditions. They rarely have kno wledge of the 
precise measures used to evaluate pupil growth 
even in those areas where such measures are a- 
vailable. Those measures which they do consult 
are in only limited areas of the total school pur- 
They resort, then, to judgments concern- 
room discipline, personalattractiveness 
apparent alertness, behavior in faculty meetings, 
reports of pupils, parents, otherteachers and the 
like, all interpreted in the light of their own ed- 
ucational philosophy or the philosophy of the in- 
vestigator who has prepared a rating chart for 
them. And when rating charts are used, or when 
training in rating is undertaken, the evaluations 
return to the evaluation of specifics-- not the edu- 
cational task as a whole. 


pose. 
ing class 


The many studies here reported, incomplete 
as they are, have been necessary to provide cer- 
tain preliminary soundings. More of them are 
needed. Then, as certain factors specific to par- 
ticular situations appear, the attempt will follow 
to establish their interrelationships. 
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CHAPTER XII 


TEACHER EFFECTIVENESS AND ITS CORRELATES 


A. S. BARR 


It is the purpose of this chapter to provide a 
summary of the major findings of the series of 
investigations here summarized. It may be ob- 
servedfirstthatthere are many approaches made 


to teacher evaluation em phasizing various con- 
siderations: 


I. Some general observations relative to the var- 
ious approaches made to teacher evaluation 

I. Investigations of the measurement and 
prediction of teacher effectiveness may 
serve many purposes: 

a. To validate admission practices; 

b. To validateteacher education curricula 

c. To validate placement and employment 
practices; 

d. To determine on-the-job effectiveness, 

2. Investigations of the measurem ent and 
prediction of teacher effectiveness differ 
greatly in scope: 

a. Some aim to determine effectiveness; 
Some to predict effectiveness; and some 
attempt both; 

b. Some aim to determine teacher effec- 
tiveness in some particular aspect of 
teaching in a carefully controlled situ- 
ation; and some aim to determine gen- 
eral teacher effectiveness with respect 
to all teacher responsibilities and in a 
variety of situations. The same aims 
could apply to prediction; 

c. Some aim to determine effectiveness 
With reference to some particular cri- 
terion and some aim to determine 
teacher effectiveness with reference to 
a multiple criterion, 

3. Investigations relative to the measure- 
ment and prediction of teacher effective- 
ness employ different criteria: 

a. Some employ supervisory and admin- 
istrative efficiency ratings; 

b. Some employ time and frequency stud- 
ies of behavior to draw inferences that 
become criteria of tea cher effective- 
ness; 

c. Some employ composites of scores on 
tests thought to measure important pre- 
requisites of teacher effectiveness; 

d. Some employ measures of pupil change. 


4. Investigations relative tothe measurement 
and prediction of teacher effectiveness 
have different psychological concerns: 


a. 


Some are concerned primarily with 
teacher competencies, performance, 
and behavior; 

Some are concerned primarily with per- 
sonal fitness, character and personal- 
ity traits and qualities of the person; 


. Some are concerned primarily with 


those knowledges, skills, and attitudes 
that constitute the prerequisites 
to teacher effectiveness; 


. Some are concerned primarily with the 


products of teacher activities and only 
incidentally with teachers as such. 


d 
. Investigations of the measurement ап 


prediction of teacher effectiveness define 
teaching differently: 


a. 


Some have in mind, chiefly, those ЕРИ 
tivities that опе might associate yas 
the teacher as a director of learner 
Some would define teaching to inclu 
responsibilities for pupil guidance; ^ 
Some would include the extra curricula 
responsibilities of the teacher; ae 
Some would include the school-com™ 
nity responsibilities of the teacher; 


1 
. Some would include the extra-schoo 


professional responsibilities of the 
teacher. 


6. Investigations of the measurement oe 
prediction of teacher effectiveness emp oy 
different sorts of data-gathering devices 
constructed for different purposes and кер" 
resenting different theories of measur 
ment: 


a. 


Some are checklists aiming to take Е 
nizance only of the pressure or E 
of certain behaviors and characte 
i f situations; em 
im merely to record Be tee 
Spent upon various sorts of pes e i. 
or the frequency with which t oval 
Some aim to зла чава a A 

iors as in rating sc š : 
n ae reporting devices po 
naires and inventories) whereinthe eu = 
ject or someone answers questions; 


e. Some are ranking devic 


f. 


7. Investigations of 


p 
b 


a 


ies 
a. 


8. Investigations o 


1 es, paired com- 
parisons, andthe like, that depend up- 
on stated orinferredcriteria, upon the 
availability of the facts, and upon the 
trustworthiness of the reporter; 

Some are testing devices conforming 
more or less to the conventions of test 
construction; 

Some are verbal ге 
servers’ notes, and var 
documents. 


cords, diaries, ob- 
jous sorts of 


the measurement and 


rediction of teacher effectiveness have 
tional studies 


een predominantly correla 
nd have all the limitations of such stud- 
The coefficient of correlation measures 
going-togetherness and not cause and 
effect relationships. Many of the as- 
sumed relationships are possibly spur- 


ious; 
Coefficients of correlation ¢ annot be 
taken at face value. The size of a C0- 
efficient of correlation depends upon 
many things, only one of which may be 
tionship between the variables 
under investigation and the criterion; 
Coefficients of correlation m ake as- 
the nature of human 
abilities, ones being: 
that they can b that abili- 
e additive, and t i 


sufficie nt stability in measures and 
functions to permit re liable i 
tions, all of which may or may 
ation m akes 
al assump- 
tions, some ar mes met by 
these inves ions and some are not. 


ient of correl 


redictionof teacher eff 


involve concepts 
f aptitude: ability, рег- 
ill, and ef- 


for e z 
mance, s need better 


ficiency. These conce 
definition; 
Such investigat 
human behavior: m С 
motivation, problem solving. 
tion, learnin: ransfer; 
eie long been the concern of psy- 
chologists; 


jons invol 
t 


* 
w: W. Charters and D! 
Chicago Press, 1929). 
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d. Sarn nen involve theories of 
s structure of human abilities th 
ommonest being that abilities are i- 
€ and additive 2 

e. ch investigations i 

3 involve theori 

relative to the specificity and ge wid 
ity of human abilities. ae 


Some investigators seem 
песок competent persons ronda i medias 
Нес iveness differently and that ther u ss 
different ways of combining these diff. elige] 
phases in teacher evaluation e n 


п. Categories of Effectiveness 


One of the facts brought home, ti 
каш these investigations, is TT time 
= arem employ a very extensive vi телев 
іп describing teacher effectiveness. т 
ее Pa escriptive terms used Боры = 

ctiveness and its prerequisi scribe 

long, but there is a tendency to use w sites very 
non-technical layma n’s sense ee гая dia 
manner characteristic of scientific stu uw ina 
where the investigators define term y. Even 
likely to define themina manner perso s they are 
erable to the investigator rather than Spies pret- 
— useful ways. This problem is ore un- 
as long plagued the behavioral science one that 
are ver few operational definitions Sphere 

ven were the vo : 

defined there is an Maur нар cd 
of terms employed in discussing the ae number 
and prediction of teacher effectivenes essment 
are too many terms employed to make mem D 
communication possible for the many Sams a gful 
who need to communicate about teacher ae jae 
ness and make predictions as inthe selecti уа 
ucation, and placement of teachers in pre oS 
programs of teacher education and T ep Co 
vision, administration, and зш super- 
staff in in-service. To secure more a of the 
lists of descriptive terms, both icri gene 
group attempts have been made to d ual and 
dense, andtelescope these many terms Dee con- 
er lists of one sort or another; on the Mowe sci 
side, factor analysis has been empio: A jective 

From the concensus approac a pA 
would appear to have been made in sila ogress 
ment of somewhat abbreviated list of dace Р 
categories that may prove useful in dis : = 
the personal prerequisites to teacher Ed Sie 
ness. The twenty-five personality traits L1 
ed by Charters* andothers have been fu € 
duced to fifteen qualities by the н ie re- 
summarized with appropriate synon es here 
list needs further reduction. yms. This 


monwealth Teacher-Training Study (Chicago: Universit 
: sity 


ouglas waples; The Com 
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10, 


11. 


12. 


. Flexibility Cap; 
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Buoyancy—Surgency, optimism, enthusiasm, 
cheerfulness, gregariousness, unsuspi- 
ciousness and uninhibitedness, talkativeness, 
sense of humor, pleasantness, carefreeness, 
vivaciousness, alertness, wittiness. 


. Considerateness—C oncern for the feelings 


and well-being of others, tolerance, sympa- 
thy, understanding, unselfishness, patience, 
helpfulness, friendliness, easy -goingness, 
geniality, generousness, warm-heartedness, 
thoughtfulness, kindliness. 


- Cooperativeness— Proneness toward joint ac- 


tion, willingness to share responsibility, 
readiness to work with others, respect for 
others, helpfulness when things need to be 
done, agreeable to worki ng with others, a 
good team worker. 


š Dependability— Reliability, loyalty, honesty, 


punctuality, res ponsibility, conscientious- 
ness, accuracy, painstakin gness, trust- 
worthiness, sincerity. 


. Emotional Stability—Realism in facing life’s 


problems, freedom from emotional tensions, 
not easily upset, poised, self-controlled, re- 
laxed, steady, unhurried, consistant. 


Ethicalness—Good taste, modesty, morality, 
conventionality, cultural polish, refinement, 


. Expressiveness—Skill in communication, re- 
eee Caen 


Sponsiveness, verbal fluency, articulate- 


ness, agreeableness of voice, good inflec- 
tion, audibility. 


acity for approaching things 
in & novel manner, imaginativeness, adapt- 
ability, inventiveness, initiativeness, orig- 


inality, creativeness, enterprisingness, re- 
sourcefulness, 


. Forcefulness— 


[ € Ascendance, dominance, con- 
fidence, independence, self i 
self-reliance, persistence 


» persuasiveness 
spect, aggressiveness. 


Judgment—Wisdom inthe sel 
priate courses of action. qj 


» foresi 
clearheadedness. 


Mental Alertness— Brightness, intelligence, 
academic aptitude, capacity for thinking, 
power to comprehend. 


Objectivity—Fairness, impartiality, open- 
mindedness, freedom from prej udice, use 


13 


14. 


15. 


of factual evidence in making criticisms and 
decisions. 


. Personal Magnetism— Att r actively dressed, 


good physique, absence of distracting physi- 
cal defects, absence of distracting manner- 
isms, cleanliness, posture, personal charm, 
appearance. 


Physical Energy and Drive— Readiness for ac- 
tion, drive, physical vigor and energy, de- 
termination, desire to get things done, vi- 
tality, endurance. 


Scholarliness—Scholastic aptitude, thorough 
knowledge of subject, being well informed on 
many subjects, high verbal aptitude, widely 
read, literateness. 


In another approach, a list of the major re- 


sponsibilities oftheteacher has been suggested in 
the Wisconsin adaptation of the M Blank of the 
Evaluative Criteria, under the four broad cate- 
gories as tollows: 


A. 


B. 
C. 
D 


The teacher as a director of learning 

The teacher as a friend and counselor of 
pupils 

The teacher as a member of a school com- 
munity 

The teacher as a member of associations of 
professional workers 


Barr (5) in a summary of research relative to the 
measurement and prediction of teaching efficiency, 
besides categorizing the personal characteristic 
ofteachers, found investigators concerned wit 
categories as follows: 


A. 


B. 


Various sorts of skills 

l. Skill in identifying pupil needs 

2. Skill in setting and defining goals 

3. Skill in creating favorable mind sets, 
readiness, motivation т 

4. Skill in choosing learning experiences 

5. Skill in directing the learning process 

6. Skill in using vem deca E 

7 ill in teacher-pup : 

8 kil " appraising pupil growth and 
achievement 

9. Skill in appraising management : 

10. bem in developing suitable Hs ger 

11. Skill in the use of language an 


dia of communication 


Knowledges x 
1. ре, ê of child behavior, development 
and learning П: 
2. Knowledge of subject taught or activity di 
rected , 
3. Knowledge of professional practices and 


y 


techniques 
4. General cultural background 
5. Scholarship 


C. Interests, attitudes, ideals 

1. Interest in pupils 

2. Interest in subject taught ога 
rected 

3. Interest in teaching and related profes- 
sional activities 

4. Interest in school an 
activities 

5. Interest in community 

6. Interest in self-improvement 

7. Social attitudes and values 


ctivity di- 


d extra-curric ular 


In the products approachto the measurement 
and prediction of teacher effectiveness, there is 
no substantial categorizing of the products of ed- 
ucation. The main products would appear to be 
effects on pupils, effects on co-worker, effects 
on parents and other members of the community, 
and effects upon professional workers wherever 
they may be and by whatever means. The pro- 
ducts may also be material things: course out- 
lines, teaching aids, textbooks, professional 
books and articles, and whatever the tangible pro- 
ducts of the teacher’s efforts may be. There 15 
need for careful definition of products. 

Turning in another direction, some progress 
may have been made in deve 10 ping categories 
through the use of factor analysis techniques. 


i 4), Hampton (33) Schmid (70), 
Е р E ade factor analyses. 


Lamke (46) and others ™ 

Hellfritzsch made two factor analyses. Erom 
one of his analyses he found four factors which he 
chose to designate poth by letters and verbally as 


follows: 


GKMA General Kn 
TRS Teacher Rating Scale Factor 
PESA Personal, 
EATP Bulogizing 
ing profession 
In a second analysis he found the following fac- 
tors: 
and Mental Ability 


GI ledge 
KMA General Know Pn Factor 


TRS Teacher Rating Sc 1 
PEA Personal Emotional Adjustment. n 
EATP Eulogizing Attitude Towar 
ing Profession 
PGTA Teaching Ability Facto” 
t named fac- 


The chief components m 
tor were liberalsocial peliefs and ores 
ing knowledge of the symptom: vues tment prob- 
үе for various kinds of pupil adjus 

em. 
Schmid (70) analy z ed the data for me 


n and 
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women separately. From the analysis of 
scores he found the following factors: PES 


PRS Problems Response Set 
PM Professional Maturity 
INT Introversion 

SA Social Adjustment 


Two common factors were found from the analy- 
ses of male scores: 


SEA Social and Educational Adjustment 
PPF Personality-Psychological Factor 


The Washburne test scores possessed the 
greatest discriminative value for measuring so- 
cial and educational adjustment and the Mooney 
Problem Check List the best measure for the per- 
sonality-psy chological factor. The full meaning 
of these conclusions can be hadonly from a care- 
ful study of the data themselves. In comparing 
these results with those of Hellfritzsch, one ob- 
serves that research design, the measures em- 
ployed, and vo cabulary preferences in naming 
factors may give what appears to be on the surf- 
ace different factor structure. The two studies 
agree, however, in emphasizing personal-social 
adjustment and related matters. 

Hampton (33), basing her analyses upon a 
twelve-item rating scale and several different 
groups of teachers found common factors as fol- 


lows: 


Professional mindedness, i. e., teachers attitude 
toward the school and administration 

Technical competencies, i. e., knowledge of sub- 
ject matter, discipline, emotional poise, 
general culture, resourcefulness, speech 

Physical attributes, i.e. health, vitality, per- 


sonal appearance 


Subsequent analyses appeared to support the first 
analysis in some respects but with very definite 
shifting of groupings in several instances. 

Lamke (40) with yet adifferent research de- 
sign and using the Cattell 16 PF test concludes 
that good teachers are likely to be talkative, 
cheerful, placid, frank, and quick, while poor 
teachers are likely to be silent, depressed, anx- 
ious, uncommunicative, and languid. 
while these studies make some contribution 
to the stru cturing of teaching ability, it seems 
reasonably apparent that the structure secured is 
quite clearly tied to the researchdesign, the data- 
gathering devices employed, the teachers studied 
the value system, and the vocabulary of the par- 
ticular investigator. The progress in this direc- 
tion, when viewed in retrospe ct, seems quite 
meager. 

In brief, the purpose of this particular sum- 
ary, that is, the summary in this section, is to 
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suggest that there is a problem of terminology in 
the area of evaluating and predicting teacher ef- 
fectiveness. For practical reasons the list must 
be shortened, but it must be done according to 
established fact; theory is important but theory 
is not enough. The researches here summarized 
appear to make some contribution to the categor- 
ization of human ability. 


IH. Some Further Observations that Seem to Grow 
Out of the Investigations Here Summarized 


1. While there are many possible designs 
for research in this area, the researches 
here summarized are for the most part 
descriptive investigations carried on 
withavailable populations or total popu- 
lations inparticularsituations. For the 
most part, these investigators have not 
attempted to generalize beyond the pop- 
ulations studied. "Whether one needs to 
limit the findingstothe populations stud- 
iedor whether one might correctly gen- 
eralize beyondthese populations to some 
larger population of which these popula- 
tions may ber epresentative is a moot 
problem of research design. 


2. Within a descriptive, exploratory frame 
of reference, the researches here sum- 
marized employed a great variety of re- 
search techniques: 

a. There are a very large number of 
status studies, each design chosen to 
fit the pur po ses of a particular re- 
search, in which observation, tests, 
interviews, questionnaires, and other 
data-gathering devices were em- 
ployed to ascertain the status of some- 
thing, as for exam ple, the opinions 
of teachers, superintendents, and ed- 
ucational specialists about the com- 
petencies needed by teachers, the at- 
titudes and beliefs of teachers on all 
sorts of matters, the expectancies of 
school board members about the per- 
sonal livesof teachers, what teachers 
do in the clas srooms, and various 
situational factors, 

b. There were studies of the likenesses 
and differences amo ng and between 
good and poor teachers relative to age, 
training, sex, classroom behavior, 
temperament, personal characteris- 
tics, beliefs, and many other things. 

c. There werea limited few experiment- 
al studies pertaining to both the pre- 
service and in-service characteris- 
tics of teachers. 

d. There were many short-term and 
long-term case studies pertaining to 


many aspects of teacher effectiveness 

e. There were many simple correlation- 
al analyses. 

f. There were a number of factorial 
analyses based upona variety of data- 
gathering devices and pursued with 
reference to different aspects of 
teacher effectiveness. 

g. There were a very large number of 
prediction studies employing regres- 
sion techniques. | 

h. There were many follow-upstudies 
of the students graduated from the 
University of Wisconsin performed 
primarily for evaluative purposes. 

i. There werea number of validation 
studies aiming to test the validity of 
particular data-gathering devices, 
such, for example, as the Minnesota 
Multiphasic Personality Inventory, 
various tests of teacher-pupil rela- 
tions, personality rating scales, and 
ateacher judgment scale. The in- 
strumentation was usually com plex 
and the statistics relatively simple, 
the degree of statistical sophistication 
varying from investigation to inves- 
tigation. 


The two problems, namely, the problem 
of estimating and predicting a teacher s 
effectiveness in a particular situation, 
and the problem of estimating and pre- 
dicting the teacher's effectiveness in 
general, i.e., in a variety of situation’ 
with a variety of pupils aiming to асћіех 
а variety of purposes within а M 
ава of specialization, should be Mies 
y differentiated. To make this di 
entiation one might observe first t E 
every situation is composed, from OT 
point of view, of two sets of factors: ioá 
those unique to the particular cae 
and the conditions surrounding it, fis 
2) those factors, elements or aspec ^ 
common to all or to wp of um 
s ined area of speciali . 
within a define not extend: beyond.s. 
One's concern may í itua- 
Р in a particular situ 
particular teacher have charac- 
tion, but even so, she may ith other 
die e common with o 
teristics that are tions. Ifone's 
teachers in other situa а eral 
š ith the problem of gener: 
concern is is theresearchdesign will 
teaching ability, rdinarily begins by 
be different. One o : ; 
es ing the populations to beinvestigat- 
ert de populations are not merely 
populations of teachers, but of pupils, 
purposes, and conditions. Sampli ng 
techniques are frequently essential to 
this type of concern. 


" 
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marized are concerned wit 


ns here sum- 


Insofar as the investigatio: 
h the general 


teaching ability of particular teachers, i.e., 
the ability to achieve the purposes of educa- 


tion with many sorts o 
situations for a given ty 
area of specialization, t 
vestigations is not suchas 
formation. The designs ar 
supply this information. 
formation there would пе 
variety in pupils, situ 
for each teacher to es 
ing ability even within a 


f pupils in a variety of 
pe of assignment or 
he design of the in- 
to provide this in- 
e too localized to 
To supply this in- 
ed to be much more 
ations, and purposes 
tablish general teach- 
limited area of spe- 


cialization. 


of teacher effective- 
ness have been employed in these inves- 
tigations, namely, ings of teacher 
efficiency made by many different types 
of raters; other te teach- 
er training personnel, su 
superintendents withthe aid of man 
of rating scales; p) pupil gain $C 
tests thought to measure 

(most of these Scor 

the effects of measura 
fluencing learning); c) compo: 
on tests of qualities thought t 
ated with tea c her effectiveness; d) sys- 
tematic studies of t he classroom behav- 
ior of teachers and pupils; e) grades in 
practice teaching; and f) grade point aver- 
ages in all professional cour 
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i rogram. In this con- 
= ات‎ реч, ae added, from the 
data in the different studies it would ap- 
pear that the ja measure 
different aspec 
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ith crite? jon building were 
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should be reasonably com i 
ences in coverage тоша TT 
lead to differences in results. If im 
example, the personal балагат нев 
арргоасһ is used in criterion building, 
it might be extendedto include both pe E 
sonal and professional р печете пив 
if pupil gain is used as the criteri s 
then it might be extended to cover € 
sonality changes in pupils as well as : b- 
ject matter outcomes, and if the bas ic 
prerequisites approachis employed th "n 
the criteria may need to be extended Ha 
include a wider range of knowledges a 
titudes, and skills; c) the voc abulary 
used in all approaches will need to be 
more carefully defined and equated fro. Š 
one approach to another. Operatio: al 
definitions might be used where a) А. 
priate; d) more attention must be a 
to data-gathering processes. It Has a 
beensaidthattests must be valid and em 
liable, but these concepts must be à 
plied to all data-gathering devices (sam š 
pling and drawing inferences from be- 
haviors present very special difficulties), 
and e) special attention must be given to 
the manner of summarizing data. та 
some instances th c 
— they would appear not to 


While all of the criteria pre i 
problems, Worcester, Min pe chc = 
cussion in this summary, has called at 
tention to the inadequate training of the 
educational personnel for their єўїт 
ative responsibilities. He was speaking 
particularly of efficiency ratings but 
this inadequacy extends to almost all 
aspects of educational evaluation. It i 
particularly applicable to the pupil alin 
criterion. Two problems that need € 
ticular attention in the use of this iu 
terion are: 1)the measurement nobeni 
and 2) the reparation of teacher effect 5 
from other matters that produce chan 2 
in pupil growth and achievement. V: 
Withreferencetothe first, while no 
more thanahalfcentury has been dert 
ed to test construction, there are many 
important educational outcomes witho t 
valid and reliable measuring posi 
ments. И While those investigators using 
the pupil change criterion in the dies 
studies here summarized were w 1 
aware of this matter and while attem Я 
меге made to measure certain ofthe E 
informational outcomes, the inadequacy 
is prese nt nonetheless and must ha А 
continued attention. The greatest ere 
were inthe realm of personality devel 
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opment and pupil growth. Beyond this, 
the low correlations found between the pu- 
pil gain criterion and the other criteria 
can be traced, among many other things, 
to the lack of curricular validity of the 
tests employed. Teachers are an inde- 
pendent lot. While some doubtlessly taught 
for the test objectives and content, there 
are probably just as many that went their 
own free way, and this will influence the 
relationships studied. As to the inter- 
mixture of effects, the adjusted pupil gain 
Score, used in the investigations repre- 
sented an attempt to take into considera- 
tion fairly commonly recognized non- 
teacher influences. There were many 
more. Incidentally, all of these investi- 
gators concerned themselves with the im- 
mediate learning effects, the more remote 
may be more important. 


- There is much unevenness in the abilities 


of teachers, i.e., they may be low in some 
abilities and high inothers. There appear 
to be very few multi- talented teachers. 
From thedata here summarized, it might 
be hypothesized that a good teacher is one 
that has one or more Special talents and 
no deficiencies that the School, commun- 
ity, or administration consider critical, 
with many intermediate abilities Spread 
more or less normally between these ex- 
tremes. 

In this connection, thequestion arises 
as to whether abilities are additive or not, 
that is, whether Shortages in one ability 
may be made up by an abundance in an- 
other. This would appear not to be true; 
iftrue, then possibly only for closely cor- 
related measures. It is possible that 
there may be a number of un correlated 
factors in teacher effectiveness each with 
an unspecified minimum cut-off point be- 
low which one may not fall and be an ef- 
fective teacher. Falling below this cut- 
off point in any one critical factor, even 
though the individual may be high in all 
other factors, may make the teacher un- 
acceptable to the adm inistration, other 
teachers, pupils, and parents, or other- 
wise ineffective. It is not clear to what 
extent the investigators associated with 
the researches here sum mar ized were 
aware of this possibility or considered it 
a hypothesis worth of investigation. 


. Much time was spent in the early studies 


in the development of the foundations for 
the objective study of teacher and pupil 
behavior. Inthese activity analyses much 
time was spent in translating the then very 


subjective language employed in describ- 
ing teachers and teaching into observable 
pupil and teacher behaviors, with studies 
of their objectivity and validity. Much 
time and effort was also spent upon means 
of recording behaviors, including time 
charts, activity check lists, and sound re- 
corders for recording the verbal behav- 
iors of teachers and pupils. The first 
sound recorder making such records was 
developed by Barr, Department of Educa- 
tion, and Koehler, Electrical Engineering 
Department, University of Wisconsin. 


. Many of the early studies were concerned 


with teacher-pupil behavior and teacher- 
pupil relationships. Barr, for example, 
studying classroom behavior of teachers 
found that good teachers attended care- 
fully to pupil responses; she freq uently 
smiled appr eciatively; she was patient; 
she laughted with the class from time to 
time; she conducted discussions in a con- 
versational manner; she was enthusiastic; 
she made frequent use of pupil exper- 
iences; she possesseda variety of ways of 
commenting upon pupil responses; she had 
a good sense of humor; and she socialize 
class discussions. 

One of the hy potheses developed by 
these early studies was that teacher acts 
have an appropriateness aspect; they are 
not good or bad in general but in relation 
to purposes, persons, and situations. peo 
der such an hypothesis one would expect 
teacher behaviors, collected out of boca 
text, not to distinguish good teachers ut 
poor teachers, The parts may be pres ei 
but scrambled as it were, the effectiV й 
ness of one teacher over another a mm 
in the ordering ofthe parts, i.e., in ved 
appropriateness. Most teachers pa 
courses in pedagogy and long bros rm 
as students come to know a ү teaching 
number of the constituents oh mm 
but it takes a high level of ¢ dee constitu- 
and understanding to create i. tier ees Y 
ents and to get them BOD си fox, ien 
Aside from thie, a E arder teacher 
EO Len оо qm investigators to 
behaviors. ONE et rs is to approach 
order teacher beha vio ight 

+ inite hypotheses. They mig 
thero нден ordered from the point of 
for example, be. ess and as they con- 
view of appropriaten à sitions: 

es, persons, and situations; 
Koss Ps point ot view of important learn- 
from е Tog such as individual differ- 
ind sige enn motivation, and knowl- 
edge of progress in learning; and from the 
point of view of human relationships such 


| 
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а respect for and considerateness in the 
ion sa of pupils, permissiv eness in 
2: er-pupil relations, and pupil orient- 
e instruction. Data relative to teacher 
behavior which may not be very important 
in and of themselves in distinguishing 
good teachers from poor teachers may be- 
(с exceedingly important as materials 
or building inferences about teacher ef- 
fectiveness. 


the frequently expressed 
officials in the per- 
these investigators 
nexplored the use 


In keeping with 
interest of employing 
sonality of teachers, 


almost without exceptio 
of personality measures as predictors of 


teacher efficiency. The instruments were 
those most frequently found in the litera- 
ture of the time: the Thurstone Tempera- 
ment Scale, the Minn esota Multiphasic 


Personality Inventory, the Cattell 16 PF 
erman Temper- 


Scale, the Guilford- Zimm 
ament Survey, the Washburne Social Ad- 
justment Inventory, the Morris Trait In- 


dex L, the Ber rsonality Inven- 
tory, the Bell Adj the 
Torgerson Theory 


constructe 
tions. Noattem pt was made except by 


Bollinger (11) and singer 
the personality ofthe teachers 
changes in the pupils. 

such data arises probably ou 
ficulties tha 
the teacher € 
such as those of parents, 
and other pupils that impinge 
Then, too, these changes 


slowly spreadin| iderable inter- 
i m span of most 


investigations. 
to at-the-m om € 
igate 

nstudies, but to the residual per- 
ges which are more difficult 
to measure. 
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istics each teacher possesse 
s and 
e ey lel the characteristics е 
БА небе achers. А statement of thi. 
vie р sumably true for all gener lio 
Es Generalizations cover You. a 
pe anumber of persons, situa= 
rua cen events, and leave not covered 
ш rider in But beyondthis there ma; 
1 0 believe that where the d 
€ uem efficiency rating, each me 
m n preferences, notwithstandi s 
E act that they employed a co -— 
paupe накш, and hetends to zale high 
і eachers who la ve the сһагасі v» 
tics that we associate with excellen | 
to rate low those teachers with an tee 
of those characteristics. While сеш, 
mor a n: and a common ERASE 
ould tend to produ i ES 
nesses among raters, there m We Tp 
enough individuality left in ied ied 
duce differences in the wa ei : n 
teachers fail and succeed, i. a Em iy e 
point of view of supervisors рше E 
tors and educational specialists asc 


Teaching does not take pl i 

it takes place ina ve e poeta Pistes 
situation. This aspect of teacher PM 
tivenessis so pervasive that it need pasa 
attention than it has yet received p 
tiveness does not reside in the te d. 
per se but in the interrelationshi rod 
a number of vital aspects of a ie Anes 
teaching situation anda achen. diis 
common practice to characterize th Tes 
fective teacher interms of qualities i E 
person; time has seen the тшш fe 
from the teacher per se to the bens is 
relation to the more important aspe ri 
a situation: needs, purposes р я ° 
available means, and the socio- сара 
environment for learning and а a 
This needs careful mae cw 


From the data presented i i 
d there would E E 
еттт egories of effectiveness that 
d be recognized and more gen |, 
used in the evaluation and predi Qd 
teacher effectiveness, such for e A 
as a cognitive category recede qeu 
eeu 5 intelligence, academic i 
d id pape. ie such as those ДЫЗб- 
tal subject matter specializatio 
ral background, and professi a 
s ран an affective vir np gai 
dg ee interest, atti. 
they relate to the ater с Ix pe 
teaching; a physical fitness fed imi inis 
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posed of good health, energy and drive 
and the many bio-physical factors in ef- 
fectiveness; a personal fitness category 
composed of qualities suchas personal 
magnetism, coo perativeness, buoyancy, 
considerateness, emotional stability, eth- 
icality, expressiveness, forcefulness, in- 
telligence, judgment, objectivity, physi- 
cal energy, reliability, resourcefulness. 
and scholastic proficiency; a professional 
competency category where knowledges, 
skills, attitudes, andpersonal character- 
istics are put together in action which can 
be further characterized; and a general- 
ized skills category composed of skills 
such as the arts of communication, skill 
in human relations, and the many manip- 
ulative and verbal skills associated with 
teaching. One is impressed by the lack 
of agreement among investigators in their 
approaches to teacher evaluation and in 
the vocabulary used to describe it. Every 
investigator would appear to be a law un- 
to himself with his own categories. Pos- 
sibly the time has now arrived for more 
agreements in approaches. 


As one studies these many investigations 
the need for some generally acceptable 
comprehensive theory of the nature and 
structure of human abilities, as exhibited 
in teaching ability, is strongly felt. It is 
not that these investigators were not well 
versed in psychological theor y but that 
each, like most investigators inthis area, 
has his owntheory, carefully stated or 
assumed. For progress in research in 
any area there is need for individuality, 
but for action there is also need for con- 
census such as might be had by teams of 
scholars and the school personnel looking 
for agreements. This monograph presents 
no such theory of human abilities, but its 
authors believe that some of the building 
blocks for sucha structure have been 
moved to a building site. 


Some persons will consider the studies 
here summarized too intricate and detailed 
to be very helpful to the practitioner. In 
that connection, two observations are 
offered: a) These are exploratory studies. 
It is common observation within the his- 
tory of science and invention that the first 
attempts at implementation ang instru- 
mentation are frequently quite crude and 
primitive. These investigators have been 
looking for leads. Many of their leads 
willgrowup. And b) if one expects school 
administrators to set ап example in the 
humane management of its personnel, their 


16. 


iT 


interests must extend beyond hiring and 
firing teachersto helpingthem, and to the 
more general development and conserva- 
tion of humanresources. From this point 
of view, the aim of these investigations 
has been to suggest different sets of cri- 
teria withappropriate instrumentation that 
might serveas preliminary screening de- 
vices. These preliminary screening de- 
vices should provide information relative 
to the overall effectiveness of teachers, 
with some ideaastotheir major strengths 
and weaknesses. The more detailed ex- 
amination of weaknesses, if there are 
such, will need to be explored through the 
aid ofother professional groups and other 
specialists who provide services relative 
to the bio- physical and psychological foun- 
dations of human behavior, i. e., with good 
instrumentation the job is not complete. 


As one reads the literature, examines 
these investigations, and thinks carefully 
about the problem, one gets the impres- 
sion, with a few excellent examplesto the 
contrary, that many of these investigators 
have been too closely hemmed in by cer- 
tain sets of realities to the neglect of 
others. Ina certain sense it is not SO 
much what the situation is as what one 
thinks it is, and these discrepancies be- 
tween reality and what one thinks must al- 
so be investigated. There are many per- 
ceptions of, and expectancies relative to, 
the various aspects of each learning- 
teaching situation that must have closer 
study, and attitudes that must be explored. 
One will find many instances in these 
studies where they have been explored, as 
for example, the studies of the perception 
and expectations that high-school seniors 
hold with referencetoteachers and teac 
ing, that school board members have O 

teachers, or that teachers hold of them- 
selves, and the annoyances and eee 
tions that attend teaching. But they nee 

more systematic consideration. 


While only limited use was made of e rod 
analysis, the factors secured see ү 
be products of the research dont. m 
data-gathering devices odeur A oe 
eee teaching аво tne investigator. 
cal панинен vio of factor anal- 

= orn more attention must be 
ee sy c nological orientation, the 
PARN devices, and the original 
correlation to which factor analysis tech- 
niques are employed. The papers by Abel 
and Schmid seem to show that there are 
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also very much improved statistical pro- 
cedures that one may em ploy with im- 
provement in the information secured. 


It is possible that the regression technique 
so generally employed in these investiga- 
tions does a reasonably good job in pre- 
dicting potential, but many teachers do 
not live up to the expectations relative to 
them. There are many things that bring 
about these discrepancies: lack of inter- 
est in the subject taught, in the pupils, or 
in teaching itself, attitudes and values not 
acceptable to the administration, to the 
majority of the teachers, parents 
and pupils; personal and professional in- 
compatibilities of various sorts; and in- 
flexibilities that may limit each teacher's 


effectiveness. 


There is some evidence in these investi- 
gations that the so-called «efficiency 
rating" may be to acertain extent a com- 
patibility rating. The extent to which this 
might be true would appear to depend 

ter and somewhat upon 


greatly upon the rai 
the rating instruments em 


In looking back over the investigations 
herein summarized, one might ask what 
progress has been made? In brief, pro- 
gress would appear to have been made in 
clarifyingthe problem, in indicating some 
alternative Way of structuring teaching 
ability, in indicating some 

nents of teaching ability, 
some matters that need to 


i lopini designs for fu I 
jn pen а ches here summarized 


While the resear 
very in quality and are far from perfect, 
substantial pro 


teacher evaluat ion 
teacher effectiveness. Inthe prediction 


ectiveness, where multiple 
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amount of research, has anyone been able 
to predict effectiveness in a complex field 
like teaching with greater accuracy. As 
has been pointed out elsewhere, it is en- 
tirely conceivable that the constituents of 
teacher effectiveness are not additive and 
that better measures of effectiveness and 
prediction can be had by new concepts of 
the structure of teaching ability. By the 
use of the insights andthe techniques here- 
in presented, carefully and cautiously as 
one should, one can expect to improve up- 
on current practice. 


21. The evaluation of human efficiency at 
whatever leveland for whatever purposes 
isanexceedingly complex necessity which 
needs to be made with extreme care. To 
secure accurate evalu ations, one must 
utilize every known check on accuracy, 
such as multiple criteria until different 
criteria can be shown to give similar re- 
sults or other criteria can be shown to be 
untenable witha variety of data-gathering 
devices all chosen because of their pre- 
sumed validity and co v e rage, and more 
than one evaluator who will employ data 
collectedover some period of time. Much 
of human import depends upon the accuracy 
ofteacher evaluation. Some would not 
evaluateteachers, but evaluation is ines- 
capable, that is, they are generally made 
whether made openly and carefully or 
made subversively and haphazardly. It 
has been the purpose of the investigations 
here summarized to clarify some of the 
problems and issues associated with valid 
and reliable evaluations. 


IV. Some More Specific Findings 


The findings here summarized are those of 
single investigations of some few studies as con- 
trasted with the generalizations just stated which 
were generally based upon several studies. 

1. Barr (3) in a study of the behavior of good 
and poor teachers found no teacher behaviors that 
distinguished one group from theother. He con- 
cluded that there were apparently critical factors 
and contributing factors in teacher effectiveness 
and that there was an appropriateness aspect to 
teacher activities that must be taken into con- 
sideration in teacher evaluation. Behavioral data 
might be used as a basis for inferences drawn 
about the personal and professional prerequisites 
to effectiveness. 

1a. Butler (15) defined the competencies nec- 
essary for effective teaching in the realm of 
classroom management basedupon published re- 


search. 
2. Jayne (37) from two parallel studies of the 
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relationship between specific teaching procedures 
and pupil gain, found no single procedure to be 
significantly correlated with pupil gain in both 
studies. He concluded that procedures are pos- 
itively, negatively, or not at all related, depend- 
ing upon purposes and conditions. 

3. Brookover (12) found that teachers witha 
high degree of person-to-person interaction with 
their students tend to be rated high as instructors 
by these same pupils (r 2.64), but these evalu- 
ations correlated near zero (r = .08) with admin- 
istrators' ratings. 

4. VonHaden (82) found that personal subjec- 
tive data made a substantial contribution to the 
accuracy of predictions of teacher effectiveness. 

5. Grotke (31) found that the data of his study 
did not fully supportthe hypothesized relationship 
that professional distance between the raters and 
ratees might be related to merit rating. 

6. La Duke (45) found that the intelligence of 
seventh- and eighth-grade teachers in one-room 
rural schools correlated Significantly with pupil 
gain as the criterion (г = . 61). Other studies 
secured conflicting results arising from a differ- 
ent set of conditions. 

7. MeCoard (55) found a speech factor in 
teacher effectiveness. 

8. Rostker (66) found statistically significant 
coefficients of correlation bet ween twelve tests 
of intelligence, knowledge of content, mental 
health and adjustment, and various attitudes with 
a pupil gain criterion and non-statistically sig- 
nificant correlations betweenfive other tests and 
five teacher rating scales, 

9. Von Eschen (81) reports statistically sig- 
nificant changes inteachers under supervision in 
social attitudes as measured by the Hartmann, 
Social Attitudes of Secondary School Teachers, 
Part II, and in teacher-pupil relations as meas- 
ured by the Torgerson Test of Teacher- Pupil Re- 
lationships. 

10. Blum (10) found that Students preparing 
to teach did not differ significantly from those 
preparing for four other professions as measured 
by the Minnesota Multiphasic Personality Inven- 
tory, but that they did differ in their vocational 
and non- vocational interests as measured by 
the Strong Vocational Interest Blank. 

11. Jackson (36) constructed a test of social 
competency and studied its relationships to teach- 
er effectiveness. 

12. Schick (69) attempted unsuccessfully to 
validate a teacher judgment scale which corre- 
lated with a criterion of supervisory ratings, 
г =.21, 

13. Lamke (46) from the use of the Cattell 
16 PF Test found thatthe responses of good and 
poor teachers did not fall into two well-defined 
patterns, but that there was more than one pat- 
tern for each. 

14, Manwiller (52) studied the expectancies 


of school board members and found large areas 
of agreement with teachers. 

15. Stoelting (75) found for University of Wis- 
consin graduates that if the minimum grade-point 
average were increased from the 1.3, now em- 
ployed, to 1.5, formerly employed, the higher 
minimum would screen out 13 of the 24 who were 
judged to be less than average in teaching ability 
but at the same time eliminate 31 who were aver- 
age, 7 who rated above ave rage, and one who 
rated superior. 

16. Martindale (53) thought that there were a 


number of specific situational factors that were 


critical in teacher effectiveness. 

17. Jones (41) found from ause ofthe discrim- 
inate function a significant difference between the 
group of good teachers and the group of average 
teachers (none were judged to be poor) in terms 
of the profile of group means, with the greater 
differences found in 1) grade-point averages in 
professional courses; 2) grade-point ave rage in 
courses related to the major; 3) flexibility in nu- 
merical ability; 4) dispositional rigidity as meas- 
ured by an Alphabet Test; and 5) a general activ- 


ity personality variable. 


17a. Knox (44) found a low positive relation- 
ship between efficiency ratings and various situ- 
ational factors. The most dissatisfied teachers 
received the lowest rating and the least dissatis- 
fied (i. e., the most satisfied) the highest ratings. 

18. Flanagan (26) and Rieck (62) found, in 
general, that selective factors had removed those 
With critical scores on the Minnesota Multiphasic 
Inventory but that individual differ ences still 
existed, 

19. Torrence (79) found no statistically sig- 
nificant correlation between teacher effectiveness 
as he measured it and the vocational agricul- 
ture teacher’s knowledge of technical agriculture, 
agricultural manipulative skills, knowledge of 
professional education or combinations of these. 

20. Bach (2) found a negligible relationship 
between practice teaching grades in the Wiscon- 
sin High School and the criterion of supervisory 
ratings. А 

21. Gotham (30) concludes that one of the sig- 
nificant findings of his investigation was the lack 
of agreement found among the several criteria: 
between pupil change and tests of qualities com- 
monly associated with teaching success (. 13); 
between pupil change and composite of scores on 
personality scales and tests (. 27); and between 
personality measures and tests of qualities com- 
monly associated with teaching efficiency (. 32). 

22. Doane (18) found ina Study reported in 
1947 that the eight most fr €quently required 
courses in education were student teaching, edu- 
cational psychology, principles of teaching, gen- 
eral psychology, methods ofteaching one or more 
of the School subjects, principles of secondary 
education, introduction to education, and educa- 


tional measurements. One may assume that such 
courses express in partthe competencies expect- 
ed of teachers. 
š 23. Best (9) found that c andidates for the 
eaching profession reveal adefiniteness of pur- 
pose relative to and a sincere respect for teach- 
а a profession. These respondents gave for 
elr reasons for choosing teaching as a profes- 
sion: interest in children and young people, Op- 
erai to work ina field of major interest, 
Ы ers a life-long oppo rtunity to learn, like to 
"us with people, to serve society, a good job to 
^ 1 back on in an emergency, long vacations, 
ravel, study, and an assured income. 
мещ. Schmid (70) foundthe factor patterns for 
eee to be somewhat different than those for 
cial m. Riesch (63) found that the Washburne So- 
dicen justment Inventory, the Wood Right Con- 
tust est, andthe California Test of Mental Ma- 
ti y were of little value in predicting the effec- 
veness of rural ог city seventh- and eighth-grade 
teachers. 
we Thiede (76) found that women students 
of E the teachers’ certificate at the University 
the isconsin scored nine percentile points above 
? men on high-school rank and four percentile 
points below them on the psychological examina- 
Unt? but exceeded other undergraduates at the 
gehen coe of Wisconsin in twenty-two of twenty- 
en comparisons. The men did not fare quite 
as well depending upon the area of specialization. 
27. Schwartz (72) found that of factors meas- 
ured by nineteen Objective Tests of Primary 
Source Trait, only three showed a statistically 
Significant relationship with more than one cri- 
teria. Two-Hand Coordination and Reaction time 
gave statistically significant correlations with 
Supervisory rating of teacher effectiveness in the 
field of teaching. 


28. Hampton (33) found that teachers were 


generally rated highest in cooperation and loy- 
alty, courtesy and friendliness, and lowest in 
knowledge of subject matter, general culture, re- 


Sourcefulness, and speech. Resourcefulness and 
; t matter seem to be the qual- 


knowledge of subjec i d 
ities most frequently sought by Iowa guperintsat 
ents. 

29. Ringness (64) 
success is related to the 
for the choice of te ac hin: 
further found that an overall 
growing out of aninterview wi з 8 
ents and an average of three ratings 
efficiency correlated . 90 for men and . 82 jor 


that a teacher's 
e reasons 
g as a p He 
acce 
th the superintend- 


women. ist 
30. Lien (48) concluded that differences exis 
between students in the various undergraduate 
State College from 


curricula at the Wisconsin 
Which his subjects were drawn. 
found in interests and personal qu 


Differences were 
alities as well 
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as abilities. 

31. Erickson (24) concluded f. 
analysis of nine measures of навора та 
that there was no general factor, but three eae 
measuring different things. The prediction of 
teaching success as measured by these three com- 
posite criteria, i.e., from 7 measures of tem- 
perament (Thurstone), 16 measures of personal- 
ity (Cattell), and10 measures of pre-service 
achievement and intelligence was not successful 
the correlations ranging from -. 28 to . 35. i 

32. Anderson (1) employed eight criteria of 
of teaching success among which no statistically 
significant correlations were found. 

33. Montross (57) found that five objective 
measures of temperament, nam ely, a) speed of 
tapping, b) reaction time, c) fluency (adjectives), 
d) right- and left-hand coordination, and e) maze 
number 1 correlated significantly with a compos- 
ite of five supervisory ratings, the correlations 
ranging from . 39 to . 57 with a multiple R of .73. 
In general, his findings are in agreem ent with 
those of Schwartz. 

34. Singer (73) found for social competency, 
and a social introversion score derived from the 
Minnesota Multiphasic Personality Inventory, and 


а Теасһег- Теасһег Social Distance Score moder- 
ately high coefficients of correlations in almost 
all cases with a compos ite rating criterion of 


teaching success. 1 
35. Kline (43) concluded that the satisfactions 


and annoyances that attend teaching relate to 


teacher effectiveness. 
36. Barr (4) provided a definition of the 
dicated in some detail 


teaching process, and in 
the sorts of data and data-gathering devices that 
one might use in the study of teachers and teach- 


ing. 

14) developed a projective tech- 
loyed in a study of the percep- 
iors of teachers and 


| 37. Stevens ( 
nique that she emp 
tions of high-school sen 


teaching. 
38. Torgerson (78) was among the first to 


use a pupil gain score as a criterion of teacher 
effectiveness. He later studied teacher-pupil re- 
lationships and the mental hygiene of the class- 
room situation. 

39. Schoonover (70a), Sigurdson (72a), and 
Struck (75a) made early studies of the objectivity 
and reliability of behavioral studies of teachers 


and teaching. 


V. pata-Gathering Devices that Appear to 
Warrant Further Consideration 


Collectively the investigations here summar- 
ized have em ploy ed a very large number and a 
very great variety of data-gathering devices. 
Some of these devices were especially construct- 
ed for the particular investigations here summar- 
ized and some were chosen from the literature. 
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All of the devices have come into being to meet a 
special need as seen by one or more groups of 
persons. All possess validity in varying amounts 
as can be seenfrom the data relative to each pro- 
vided in an earlier chapter. 

One of the aims of the investigations here 
summarized was to provide a more or less com- 
mon treatment for a number of devices thought to 
measure teacher effectiveness, with a common 
criterion, and thus supply data on their validity 
under a new set of conditions as described in the 
investigations here summarized. Many of the de- 
vices were employedin two or more of the inves- 
tigations. The list to follow is composed of de- 
vices that appear to have promise according to 
1) correlational data with reference to each pro- 
vided in the investigations here summarized, and 
2) face validity and impressions gained from the 
actual use of the various devices in a variety of 
situations. 

In this connection, it should probably be 
pointed out that correlational data are difficult to 
interpret, particularly inasmuch as coefficients 
of correlation cannot be taken at face value. The 
size of the coefficient of correlation depends upon 
many things including only in part the amount of 
relationship that may exist between a variable 
and a criterion. To a certain extent the size of 
the coefficient of correlationdepends upon errors 
of measurement. It also depends upon selective 
factors that have operated through the processes 
of school education, and the spread of talent that 
remains for the groups studied. As a result of 
many things, an obtained coefficient of zero, for 
example, may not mean that there is no relation- 
ship between a given variable and a criterion but 
merely that certain conditions exist. If the test’s 
reliability appears adequate for the uses to which 
it is put, it may be concluded that other factors 
have operated to eliminate any observable rela- 
tionship. 

With these limitations in mind, and with many 
reservations, anarbitrary cut-off point has been, 
nonetheless, Set for each correlation as reported 
inthese investigations; while the cut-off point 
might be set at any one of a number of points it 
was here arbitrarily set at r = . 36 by reasoning 
such as the following: 

If these were sampling Studies, which they 
are not, and the samples ranged in size from 30 
to 50 subjects, which they do, with some excep- 
tions, a coefficient of correlation of .36 would be 
statistically significant at somewhere between 
the one and five percent levels, roughly estimat- 
ed. Then, if one were employing the coefficient 
of predictive efficiency, which isa descri ptive 
statistic, then the predictive efficiency for г = . 36 
depending upon whether the coefficients are round- 
ed to one, two, or three decimal points is rough- 
ly seven percent. Another part of the logic back 
of the recommendations to follow is that of con- 


sistency, i.e., the number of times a particular 
measure appears above the cut-off point in rela- 
tion to the number of opportunities that a meas- 
ure has to appear. Rank among other measures 
of its kind may be more meaningful than the ac- 
tual size of the coefficient of correlation. 

Inasmuch as these investigations have been 
conducted over aperiod of years, many of the in- 
struments are now out of date, or out of print, and 
superseded by other measures, but the types of 
instrument found have a significant relationship 
suggestive for furtherresearch. The list may be 
helpful merely in that they indicate the sorts of 
things that appeared promising in light of the cri- 
terionused. Instruments supported by à single 
investigation are not reported. Many of the in- 
struments can be fairly described as unfinished 
business. 


Data-Gathering Devices that May Contain 
Suggestions for Further Research 


1. Measures of Cognitive Processes 

a. Grade point average for all undergraduate 
courses, for courses that compose the 
teaching major, and for the teaching minor 
plus subject matter tests over the content 
taught. 

b. Grade point average in professional 
courses. 

c. Rank in high-school class (uncorrected for 
size of school and other factors). : 

d. Thurstone's Psychological Exam ination 
for College Freshmen, American Council 
on Education, Washington, D. C., 1936, 
1938, 1939 editions. 

e. National Teachers Examination, od 
tional Testing Service, New York, 19 
edition. А 

f. Teachers College Psychological cared 
tion, State Teachers College, St. Cloud, 
Minnesota. 

2. Measures of Affective Processes Я 

а. Yeager, Scalefor Measuring Attitude 
Toward Teachers andthe Teaching Proies- 
sion, Teachers College, Columbia Univer- 

b. es eal Teacher Attitude Inventory 
by W. W. Cook, Carro П H. Leeds, and 
Robert Callis, Psychological Corporation, 
Washington, D. C., 1951. Originally de- 
scribed by Leeds and Cook in ‘“The Con- 
struction and Differential Value of a Scale 
for Determining Teacher -Pupil Attitudes, 
Journal of Experimental Education, XV 


р. = Р 
с. Hartman, Social Attitudes of Secondary 
School Teachers, John Dewey Society, New 
York, 37. | | 
3. Measures of Special Skills 
a. Teacher-pupil relationships. Torgerson 


ә, 


Test of Teacher-Pupil Relations, unpub- 
lished materials, University of Wiscon- 
sin, 1930. 

A speech proficiency test (per McCoard) 
to cover theordinary mechanics of effec- 
tive speech, fluency, vividness, etc. 


4. Measures of Personal Characteristics and 
and Personality 


a. 


9. General Merit Rating 


Composite ratings on qualities such as 
initiative and professional judgment made 
by three readers of autobiographies writ- 
ten by undergraduate students. 
Torgerson, Theory and Practice of Men- 
tal Hygiene, unpublished materials, De- 
partment of Education, University of Wis- 
consin. 

Washburne, Social Adjustment Inventory, 
Sapich Edition, Syracuse University. 

The Schwartz Teacher Temperament Scale 
(based upon data provided by Cattell on 
character and personality), unpublished 
materials, Department of Education, Un- 
iversity of Wisconsin. Described by 
Schwartz in the Journal of Experimental 
Education, XIX September i 

The Minnesota Multiphasic Personality In- 
ventory, by Starke R. Hathaway and J. 
Sharnley McKinley, Psychological Corpor- 
ation, Washington, D.C., Revised Edition, 
1951. 

The Guilford- Zimm 
Survey, Sheridan Supply Co., 
Hills, California, 1949. 


erman Temperament 
Beverly 


Unfinished Business 


perception of Personal 
› unpublished material, 
jon, Unive rsity of 
d in School Review, 


Barr, ‘‘Teacher 
Characteristics, ’ 
Department of Educat 
Wisconsin. Describe 
LXVIII (Winter 1961), pP. - 


ale for Teachers 


a. Almy- Rating Se: 
my-Sorenson Co., Blooming- 


. Wisconsin Adaptation of 


Public School Publishing CO a 
ton, Ш., 1930, described in Educational 
Administration and Supervision, XVI 
March 1930, pp. 179-80. ii 
Michigan Education Association Teacher 
Rating Card. Michigan Education Asso- 
ciation, Lansing, Michigan, 1930. " 
Torgerson Diagnostic Teacher Rating 
Scale. Public School publishing Co., 
Bloomi ., 1930. 
eng Der ne M Blank of the 


Evaluative Criteria, unpublished materia, 
Department of Education, Univ ersity 0 

Wisconsin. (Effectiveness is inferred 
from observable teacher and pupil behav- 
ior on various aspects of the teaching pro- 


cess with an overall merit rating. ) 


BARR 
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A prediction made upon the bases of a 
composite of two structured interviews 
made during the senior year in college to 
secure information relative to profession- 
al judgment; social ability; work habits; 
motivation; and originality. 


Unfinished Business 


Barr-Harris Teacher Performance Rec- 
ord. Dembar Publications, Madison, Wis- 
consin, 1943. A sequential record of 
teacher and pupil behavior from which ef- 
fectiveness is inferred and given a point 


score. 


VI. Needed Research 


More researchis needed to clear up many un- 


solved problems relative to the meas! 
ction of teacher effectiveness. 


predi 


of the most pressing 


; d 
tion, possibly before allothers, 


terion of teacher effectiveness. 


complex 
a. 


urement and 
A short list 
problems is given below. 


One of the problems that needs clarifica- 
is that of the cri- 


This problem is 


with many sub-issues: 
First, there must be an acceptable theo- 
ry of the nature and structure of teaching 
ability. Since the turn of the century many 
thoroughly competent persons have given 
prolonged attentiontothis problem. In its 
more general aspects Spearman, Thur- 
stone, Thomson, Kelley, Burt, Gilford, 
Cattell, and many others have studied this 
roblem. The prevailing theory is an el- 
ementalist factor theory withthe chief dif- 
ferences among specialists arising over 
the actuality of general ability, group fac- 
tors, and certain unnamed specifics. The 
elements are presumed to be additive. A 
hypothesis ad vanced in this summary is 
that possibly the ingredients of effective- 
ness are not additive and an inadequacy in 
any one of à number of critical factors 
may make the teac her thoroughly unac- 
ceptable to the administration, the com- 
munity or other teachers and these atti- 
tudes may bring about the immediate re- 
moval of the teacher or may create a cli- 
mate in which her usefulness or effective- 
ness is reduced, notwithstanding her abil- 
ities in other respects. The factors which 
are considered critical and the tolerance 
permitted may vary from com munity to 
community. 

So far we have been speaking of struc- 
ture. Neither is one certain whether all 
the parts have been, as yet, made known. 
If one thinks of tea c hers as machines, 
whichof course they are not, we frequently 
see these machines in operation, but no 
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one has, asyet, put one together success- 
fully, notwithstanding the many attempts 
to do so. Itis not clear whether there are 
essential parts still missing or whether 
the parts have not been assembled as they 
should be. 

b. Second, any theory of teacher effective- 
ness to be tested, involves data-gathering 
devices. Operationally, concepts of hu- 
man abilities are no better thanthe instru- 
ment that one employs in identifying them. 
Apparently there are quite a few consti- 
tuents to effectiveness, andthus, possibly 
a very large number of data-gathering de- 
vices. Imperfection in any one data-gath- 
ering device may make inoperative the 
whole model. While, obviously, much 
progress has been made in measuring the 
constituents of teacher effectiveness, 
there is muchmore that needs to be done. 

2. Two models, in general, have been em- 
ployed in the study of teacher effectiveness. One 
is the carefully controlled model, and the other 
the uncontrolled natural events models. These 
models differ in many respects but attention is 
directed here totwodifferences. First, there is 
ordinarily a difference between the two models іп 
their inconclusiveness, the controlled model be- 
ing traditionally limited to the study of a few or 
a single aspect of teacher effectiveness, as in 
controlled experimentation, and the uncontrolled 
natural events model being traditionally employed 
in studies which attempt to put together in a single 
meaningful whole some large segment of the fac- 
tors thought to determine teacher effectiveness. 
Second, these models attempt to eliminate the in- 
fluence of situational factors differently, one by 
equating effects or holding them constant, the 
other by measuring their influence and eliminat- 
ing or holding constant their effects through sta- 
tistical manipulation. There is great need for 
the integration of these two approaches to teach- 
er effectiveness. All too frequently the users of 
these two different approaches procede with min- 
imum awareness of eachother. They may even 
come from different disciplines and employ dif- 
ferent vocabularies. The controls, whether ex- 
perimentally or statistically imposed, should or- 
dinarily not differ in intent, as shown by prior 
research. Verbal acceptance ofthis union of con- 
trolled experimentation and statistics is not 
enough. We need empirical tests of their going to- 
getherness. 

3. It has been frequently pointed out in this 
monograph that different people employ different 
criteria and approaches to the evaluation of teach- 
er effectiveness. These differences arise in part 
out of differences in the theories of the nature of 
human abilities that different people hold but 
more frequently from personal preferences, some 
preferring to approach effectiveness from the 


point of view of its personal prerequisites, some 
from the point of view of teacher-pupil behaviors, 
some from the pointof view of basic knowledges, 
attitudes, and skills, and some from the point of 
view of products. The data in the investigations 
here summarized seem to show, with a high de- 
gree of consistency, that these different approach- 
es give different answers to the question: Is this 
teacher an effective teacher? Research needs to 
be undertaken to resolve these differences. 

4. Frequent reference is made in this sum- 
mary to the problem of vocabulary. It would 
seem that every researcher has his own private 
system of talking about teacher effectiveness. Re- 
search in these areas could be greatly facilitated 
if these different vocabularies could be harmo- 
nized. From a study of the many researches in 
this area it would seem that difficulty arises only 
partially out of personal preferences in the realm 
of vocabulary, but more generally because each 
researcher characteristically chooses a different 
emphasis or aspect of the teacher effectiveness 
for investigation which, of course, are in a man- 
ner necessary if progress is to be made. Pos- 
sibly the difficulty, whichis acute from the prac- 
titioner’s point of view, could be eased somewhat 
if competent scholars from different disciplines 
would be willing to turn their know-how to the de- 
velopment of verbal equivalents. 

5. One of the very real difficulties confront- 
ing the worker inthis area is the uncompleted as- 
signment. There are, one can safely assume, 
hundreds of factor analyses, experimental inves- 
tigations, and data-gathering devices initiated by 
doctoral candidates that have never gotten beyond 
the first exploratory or preliminary stages. Many 
of these researches contain very good first ideas 
but no one has followed through; as a result we 
have data-gathering devices that are good but not 
good enough, and experimental and statistical 
studies that give conflicting results that no one 
has bothered to resolve. In many instances, the 
conflicting results arise from changes in impor- 
tant ingredients from one investigation to anoint, 
which appear on the surface to be inconsequential 
but which produce important differences. | 
some of the conflicting evidence arises over ma E 
ters that might be eliminated with more care an 
continued research. There is mu ch needed re- 
search in the area of the unfinished task. 

6. One of the early and continuing con а. 
of the investigations here summarized was a 
teacher-pupil relations. The interaction of te * 
ers and pupils in the situation in which teaching 
takes place is the focal point of teaching and one 
of the critical factors in teacher effectiveness, 
whatever the objective. The early concern was 
with subject matter objectives; gradually the em- 
phasis has shifted from subject teaching per se to 
include method of studying, working, and thinking, 
and pupil adjustment. Most of the current con- 


fi 


eed hy with on-the-spot interactions as they 
mas b o these latter concerns. A matter that 
effect | е increasing concern is the permanent 
ther hai results from theseteacher-pupil inter- 
emer na their impact upon personality, which 
and par owly and from many influences: home 
mire ental influences, peer influences. and the 
Өрү: general cultural influences that arise in the 
It ео in which youth grow into adulthood. 
enc not be easy to isolate the teacher influ- 

es inthis respect, but research is needed to 


Clarity the situation. 
inve Т. Опе of the insights developed from these 
not iip isthat specific teacher acts may 
mai. or wrong in and of themselves, taken 
one EL andthat there are many alternatives 
De ds pout as good as another. But one may use 
кайы records in drawing inferences about im- 
infe nt prerequisites to teacher effectives. These 
rences may relate to the personal prerequi- 


Sites to teacher effectiveness, to the profession- 
d all aspects of the 


prerequisites, or to any an | 
fo rning-teaching situation. This has been the 
н point of classroom visitation and conference 
Om the very earliest conception of supervision. 
E crucial problem is not that we be concerned 
ith them but how to render these inferences 
oe valid and reliable. Traditionally, these in- 
rences have been very subjective and personal. 
ae problem is: How does one order these oper- 
th A tobring them more generally in keeping 
ne the conventions of science There is much 
ti eded research in this aspect of teacher effec- 
veness, 
Sor 8. There has been muc 
pes prerequisites to : 
ha en these prerequisites are operationally ( е- 
ар охану) defined they may be 1 nferred from 
re dies of observed teacher behavior. There are 
s asonable needs here. First, much of the re- 
earch pertaining to the classroom pehavior of 


te 

Pe ace has been done r 

les nS teacher-centered Y pm 
aching, democracy Versus autocracy in 


hresearch on the per- 
teacher effectiveness. 


Classr n 

i ss ver 
tiven oom, and permissivene pea 
ess. Th interest shoul e 
dis © of the personal and 


ened to include Š 
alarger group I 
nee essional ems 4 ч to teacher effective- 
ae On the personal side, the concerns a š 
extended to include source traits as well à 
fessional side to in- 
hat appear to differ- 
pational groups. 
b 


s 
oe traits; and onthe pro 
entiate ae characteristics t 
ен eaching from other occu 
ogad, teacher behaviors shou long been 
ae principles of learning that have un ета 
ны concern of educational psychology” when op- 
eratis? Of these may also be inferred, or be- 
mu E defined, from studies at е in this 

Area, ` There is much ne e ded ESER 
given to the 


9. More attention needs to be 
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critical factors in teacher efficien 

an infinite number of things that rs ewe 
do; ай wer e they done well they would ada 

class” and ‘‘polish’’ to the teachers perfo 
ance, but they are not basically essential (om 
are not critical. Some knowledge of the bi = 
taught, or interest in teaching, or in pu s 4 
professional know-how, would seem to D š 
tial to teacher effectiveness. What is the соо 
of good teaching? There is much enondedye at 
teaching that is more or less extrinsic; it mdi 
economizeuponthe efforts of many people woe 
way, somehow, the usable could be se te 
from the non-essentials. This is a m aite bien 
will demand close examination of the iih Hes 
hand and the planning of new research to s Ps E 
rate the moderately useful from the bici da I 
10. There are a lot of people that have | 

pectancies relative tothe teacher: board m is 
bers, superintendents, principals, Ку E. 
other teachers, pupils, parents, and other it 
bers of the community, and they have expect v 
cies about almost everything a пасг а E 
Some of these expectancies would seem to be ы 
essential to a teacher’s success in a given scio 1 
or community. Can these expectancies be i 
tematically spelled out and instruments devel 


sys 
d for identifying them in particular teaching 


ope 


situations ? 
11. It is difficult to find good definitions of 


teaching. Teachers do many diff 
things; they teach the different co po aah Е 
different sorts of pupils at different grade level : 
teachers are presumably friends and pron me 
of students, they may be directors of =a DEUM 
ricular activities of many sorts, both inside the 
confines of school and without, they соне ит 
of various professional and community grow s 
and presumably good citizens. Charter оаа 
a definition of teaching in the twenties; there i 
need for a definition of teaching in the sixties S 
12. Barr (4) provided, in the early thirtie 
a definition of the teaching act as seen through ne 
eyes of the supervisor and as applied to lates 
superv ision and the improvement of teachin, 
There is need of such an analysis of the pc qa 
process prepared for the use of teachers to aide 
them in their efforts at self improvement. Po E 
sibly one of the marks of a good teacher is jer 
understanding of the teaching process. Some 
dents of teaching believe that many teachers think 
of teaching techniques as timeless and universall 
applicable regardless of context rather than i 
parts of some sort of on-going process defined E 
purposes, persons, andsituations. Possibly inre 
that probe the teacher's comprehension of the 
teaching process in all of its many ramificatio м 
is anessential ofteacher effectiveness. Resea: se 
in this ae. or prove profitable. PeR 
13. Teachers frequ ently achi 
their potentialities. In the dicm " dim | 
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mation about the aspects of each learning-teaching 
situation that may limit or facilitate the teaching 
performance, prediction of teacher effectiveness 
based upon potential аге likely to be quite inaccu- 
rate regardless of their accuracy as predictions 
of potential. Teaching is limited and facilitated 
by many aspects of the situation: each teaching 
assignment places in some respect different de- 
mands uponthe teacher; the expectancies are dif- 
ferent for different schools and communities; the 
teacher morale is very high in some schools and 
communities and low inothers; the administrative 
staff and its philosophy of administration may be 
more acceptable to someteachers than to others; 
there are many annoyances and satisfactions that 
attend teaching, more in some communities than 
others; some teachers find more professional 
compatability in some schools and communities 
than in others. Research is needed to spell out 
aspects Of the situation that may limit or facili- 
tate teaching up to potential. 

14. Given a valid criterion of teacher effec- 
tiveness, one of the best tests of one’s command 
over the constituents of effective teaching is 
one’s ability to improve some particular teacher’s 
effectiveness through the manipulation of vari- 
ables thought to be associated with effectiveness. 
Demonstrations of this command are legion, but 
frequently not convincing because of inadequacies 
in the theoretical structure out of which such re- 
searches grew: inadequate definitions of the prob- 
lems to be studied, inadequate definition of im- 
portant vocabulary, inadequate data-gathering 
devices, inadequate research design, inadequate 
controls, andinferences not supported by the data 
collected. There is need for valid demonstra- 
tions of our ability to produce effective teachers 
upon demand, 

15. Much of theresearch relative to teacher 
effectiveness pertains to a particular world of 
realities in whichteachingtakes place. Fortune- 
ately, or unfortunately, teachers do not always 
live in this world of reality. They have their own 
constructs by which they live. Thus the impor- 
tance of researchrelatingtothe teachers percep- 
tion of almost any and all aspects of teaching, 
purposes, persons, and situations. Important 
beginnings have been made in Self- perception and 
the perceptions of others with reference to the 
personal prerequisites to teacher effectiveness. 
But in the absence of convincing research there 
is no particular reasonfor assumingthat her per- 
ceptions in one area are any moreimportant than 
in another. These perception studies need to be 
extended to other important components of teach- 
er effectiveness. 

16. The foundations for effectiveness will be 
found in the biophysical sources of energy and 
drive. The super Structures built upon these 
foundations have been extensively explored, but 
there is need for careful examination of the foun- 


dations. These foundations will be found in the 
genes, bodily structures, and physiological func- 
tioning: the glandular system, metabolism, the 
circulatory system, the nervous system, the spe- 
cial senses, and all those aspects that make the 
individual an efficiententity. Individuals differ in 
all of these respects. What are the critical ele- 
ments in these biophysical foundations of human 
behavior? Few educationalists, or psychologists 
for that matter, canbe said to be experts in these 
biophysical determiners of hu man effectiveness 
but more information is needed about them. 

17. Skill in speech isclosely associated with 
teacher effectiveness. Many studies have now 
been made of fluency andthe commonplace verb- 
al processitself. Itis not enough to merely study 
verbal behavior. What is verbal behavior? How 
does it relateto thinking and other bodily func- 
tions? Teachers use many words in the run of a 
day's teaching. These words used by teachers 
have different meanings from time to time and 
from person to person. Some of these meanings 
are fairly adequate, correct and complete; some 
are not. Inthese daily vocabulary exercises 
words are treated as substitutes for reality. There 
is need for studies of the words by which teachers 
live. 

18. The teacher makes many judgments in the 
run of a day’s teaching: judgments about pupil 
needs and the means to be employed in satisfying 
the judgments about rewards and punishments; 
judgments about standards of achieving and the 
means of assessing them; judgments about indi- 
vidual differences and what to do about them; judg- 
ments about learning aids and how to use them; 
judgments about pupil control, and the many other 
things associated with teaching. The teacher ef- 
fectiveness is closely associated withthese minute 
to minute decisions made by teachers. More in- 
formation is needed about them and how to assess 
their appropriateness. 


VII. Some Observations on Teacher 
Evaluation Programs 


1. Some would like to escape evaluation. This is 
not, however, very likely. It would seem that 
teachers have always been evaluated; they are 
now evaluated, and they will probably continue 
to be evaluated as long as there are teachers. 
The problem is how to bring these evaluations 
in the open and to improve their accuracy. 


2. It should be reasonably clear that teacher eval- 
uation is an exceedingly complex matter and 
those that engage in such activities should be 
aware of its complexity, of the possibilities of 
arriving at erroneous judgments, and of the 
consequences that follow from such evaluations. 


3. There is plenty of evidence to indicate that dif- 
ferent practitioners observing the same teach- 


hong. or studying data about her, may аг- 
vemm at very different evaluations of her; this 
: ervation is equally true of the evaluation 
xpert: starting with different assumptions, 
ee different approaches, and using 
ifferent data-gathering de vices they, too, 
may arrive at very different evaluations. 


It ig assumed that each school system may 
prefer to develop its own plan for evaluating 
teacher effectiveness, taking into consider- 
ation local needs, attitudes, and insights. 
The attitudes and the insights of the partici- 
pants are important items in the success of 
any plan of teacher evaluation. It is ordinar- 
ily best to start on an experimental basis. 

t to make judgments 
in effectiveness that 
e at the present 


Most evaluators attemp 
about small differences 
do not seem to be possibl 
time, consider ing current know-how an 
data-gathering devices. Possibly for the 
time being it might be best to attempt to set 
up only broad categories of teacher effec- 
tiveness, such as adequate, superior, and 
inadequate, and to do this with reference to 
pretty carefully defined situations. 

Those who setup evaluation programs should 
probably keep in m ind the fact that evalua- 
tions are made for different pur 
for example, as for purposes 
certification, empl i provement in 
Service, andfor fixing 
at different points in a t 
under varying sets 


There are different appro? 
Some would evalu ate in terms of the basic 
prerequisites to teac er eff: 
knowledges, skills, and atti 
terms of teacher performance 
and activities; some, in 

al prerequisites to teacher € 


some i upil growth 
е in terms of P Pi its advantages and 


tudes; some in 
: behaviors 


ment. Each approac 

disadvantages. 

There are many different sorts of се 
ering devices employed inteac ad ай 
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levices check lists ratini a d 

like, tests of qualities thought (o Pe estion- 

ated with teacher effectiver е teacher 


naires and interviews direct? i 
:nted with the 
or others that may be aC U“ pd records of 


teachers work; ts 
с ork; documen fore- 
аа sorts, including è p From 
ing a i i n id 
g m re med a ollect data of vary 


these sources one ma; 


BARR 


10. 


12; 


12. 


13. 


14. 


151 


ing validity an iabili 

Ax 2 dreliability. The data will not 
Evaluations may be made 

superintendents, principals, 3 med кш 
college professors, other teachers ona, 
and parents with different concepts of oe > 
er effectiveness, varying amounts of deed 
in the handling of data, and with bmi. 
levels of professional sophistication ы 
frequently have a different perce] ti d 
teaching and evaluate teachers differently ` 


For the time being, it would se 

least until the situation has аа = d 
ploy more than one approach to dleacler eds 
cation, and a variety of data-gathering devic - 
chosen for their known validity and reliabil- 
ity, with data collected over some dd 
time and assessed by more than one epson 
programs for the careful training oí eval ^ 
ators have been shown to be effective. = 


The evaluation of a teacher’s effectivenes 

when properly done, is a time-consuming — 
tivity, and when made with due regard to its 
complexity may better be done not annuall; Г 
as now pursued, but merely from time to dd 
as a need arises, andat critical points in th 

teaching cycle as for example at the time : 
employment, at the time of the termination ie 
a probationary per iod of employment, or at 
times when a major change in status is con- 


templated. 


Consideration should be given to the colle 
tion of data about such basi Sites aE 
a mus e ed ic prerequisites as 
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b) Knowledge of subje ivi 
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b) Social attitudes and values 
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pupil behavior and conditions in ће cl in. 
room, and from b) tests and other و‎ 
gathering devices pertaining to thes e 
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ject taught; attitudes peculiar to the 
subject taught; attitudes shared with 
other subjects 
c) Special skills peculiar to the subject 
taught; shared with other subjects 
d) Personality development and adjust- 
ment 
B. As a friend and counselor of pupils 
C. As a member of school community 
D. As a member of grou ps of professional 
workers 
In collecting data relative to the foregoing, 
remember that data-gathering devices are 
highly fallible: the title given to the instru- 
ment may be misleading; the notion of teach- 
er effectiveness underlying the instrument 
may be fallacious; the coverage may be in- 
complete; key words and terms may not be 
defined or may be poorly defined; the direc- 
tions for theuseofthe instrument may be in- 
complete or ambigious; the means of record- 
ing data, scores, etc., may be inadequate; 
the separationof data gathering and evaluat- 
ing processes may not be clearly indicated; 
the sampling of behavior may be inadequate; 
to mention only a few of the possible short- 
comings that may be found in the data-gath- 
ering devices themselves. But there are 
other dangers: someinstruments, no matter 
how good in and of themselves, are danger- 
ous in the hands of some people because of 
the lack of professional sophistication, be- 
cause of dee p-seated preconceived convic- 
tions that may be erroneous, and because of 
willful falsifications of data that may arise 
out of personal incompatabilities; and teach- 
ers vary in effectiveness from time to time 
and under different conditions. 


16. Within, and cutting across the foregoing sug- 


gestions, there are four major considera- 

tions that must be kept in mind: 

A. Teacher acts are not good or bad in gen- 
eral but only incontext of purposes, per- 
sons, and situations. They may be em- 
ployed inoperational definitions of impor- 
tant constituents of effectiveness and as 
data for making inferences about personal 
fitness and professional competencies, 
but not as means of distinguishing good 
teaching from poor teaching in and of them- 
selves. 

B. The constituents of effectiveness are not 
found in teachers, or in pupils, or in sit- 
uations, but in the relationships that exist 
among those at any given time and place. 
The learning-teaching situation is a dy- 
namic situation and must be so viewed. 

C. Current attempts to evaluate teacher ef- 
fectiveness deal with certain types of re- 
alities that must be given consideration, 
such, for example, as the perceptions of 
teachers, pupils, parents, and adminis- 
trators of what goes on and under what 
conditions. It is not enough to know mere- 
ly what is, but it is equally important that 
we know what people think is. 

D. Many people have expectancies relative to 
teaching: other teachers, supervisors; 
administrators, pupils, parents, board 
members, etc., and these expectancies 
must be given careful consideration in each 
particular learning and teaching situation. 


Only a few of the more important considera- 


tions have been here summarized. 
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SECTION I 


Statement of Problem 


THE PURPOSE of this study is to seek infor- 
mation about the personal-social and intellectual 
Characteristics of students preparing to teach ina 
Wisconsin state college. It is hoped that the study 
will provide infor mation not merely about the 


Characteristics of the students at any given time, 
but information about the stability of the data col- 
istics and 


lected with reference to these character! 

how they are interrelated. The answers to three 
Questions were sought regarding the personal- 
Social, intellectual, and achievement character- 
istics of the subjects: 

1, What are the personal-social, intellectual, 
and achievement characteristics of students 
preparing for teaching at a Wisconsin state 
college? 

2. What stabilit 


y does one find in such data as 


shown by a retest program ? M 
3. Are there any patterns in the abilities and 
characteristics Of wisconsin state coulege 
students as shown by correlational analysis 


of test scores? 


Interest continues to 810 ong professiona 
anq lay persons concerning chara ct er рет 
teachers, The problem of pT epar ing e ion 

Sachers faces every teacher-training e um 

П order that these institutions САП more effect Е 

organize the teac her-training curric ise ba. 
Would seem advisable to obtain mor? prec 
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formation relative to the characteristics of stu- 
dents in colleges preparing to teach, such as the 
relationships and stability of certain personal- 
social and intellectual characteristics. Eventu- 
ally one will desire to know how these character- 
istics are r elated to certain aspects of teacher 
competency. Programs of selection, recruitment, 
and education n eed a substantial factual founda- 
tion. 

It is common observation that students differ 
greatly in personal-social characteristics. The 
recognition of the personal-social characteristics 
as an important aspectof learning was pointed out 
by Havighurst and Neugarten(18). They indicated 
the areas in which the investigation of personal- 
social and intellectual behavior may be profitably 
pursued: «the college inthe social structure, ed- 
ucation and social policy, socialorigins and social 
roles of teachers. 18 

In any study of prospective teachers there is 
need of a psychology that provides adequate rec- 
ognition of personal-social, intellectual, and 
achievement characteristics. Sims (33) has shown 
some positive correlations of social class identi- 
fication among high-school and college students, 
1. e., social class identification has a significant 
relationship to plans for further education. Social 
class structure is positively related to success 
which is based on general mental ability, largely 
verbal. In planning teacher education, it is of ed- 
ucational im po rtance to know with which social 
student identifies, Every psychological 
pends upon the state of the person and at 
the same time on the environment. The experi- 
mental work of recent years shows more and more 
this twofold relationship in all fields of psychol- 
ogy. Every scientific psychology must take into 
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account the whole situation such as the personal- 
social, intellectual, and achievement characteris- 
tics of the individual relative to his social envi- 
ronment. . 


SECTION II 
Design of the Study 


THE DESIGN of this investigation is quite 
Simple. Basically it is a study of status and of 
the interrelationships among qualities thought to 
be related to teacher effectiveness. 


The Setting 


The subjects for this investigation came from 
a course in educational psychology taught by the 
author. Educational Psychology is one in a se- 
quence of courses requiredof all students at Wis- 
consin State College and Institute of Technology 
at Platteville preparing to teach in the secondary 
School. The Wisconsin State College and Institute 
of Technology at Platteville will hereafter be re- 
ferred to as WSCITP. The emphasis of the course 
is upon the nature and direction of learning. It is 
a second semester sophomore course and the first 
professional education course for these students. 
Observation in the laboratory school is a part of 
the course. A prerequisite to the course is Gen- 
eral Psychology, a first semester sophomore 
course which deals with the understanding of the 
nature of manand early childhood. It is a general 
education course and is required of all students 
except those in the technology division. 

The breadth of course material was controlled 
by the use of a common group of outside readings 
and common course assignments. All classes 
were assignedthe same required text and supple- 
mentary readings prior to common six weeks, 
nine weeks, and twelve weeks tests. A common 
final examination was administered to students of 
all classes at the same time in the same class- 
room. 

The four classes were conducted in the same 
manner by the same teacher. Their main instruc- 
tional activities included: lectures, whole class 
discussions, small group discussions and planning, 
teacher and student demonstrations, films, stu- 
dent panels, student reports, and tests. 


The Subjects 


The subjects were 114 students, 88 who were 
enrolled in a sophomore course in educational psy- 
chology the second semester of the 1957-58 aca- 
demic year, and another 26 students who were en- 
rolled in the same course the first semester of 
the 1958-59 academic year. Those students still 
enrolled at WSCITP during the second semester of 
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the 1959-60 academic year were retested. 

One hundred fourteen students completed the 
full semester's work in Educational Psychology 
223. This was considered as the total population. 
Sixty-threeofthose enrolled in the second semes- 
ter of the 1957-58 academic year, and 190f those 
enrolled inthe first semester of the 1958-59 aca- 
demic year attended WSCITP the second semester 
of the 1959-60 academic year. 

It was decided to study only those students for 
whom there was complete background information 
and who were still enrolled at WSCITP during the 
1959-60 academic school year. The educational 
and personal histories were secureddirectly from 
the students themselves, therefore this informa- 
tion was available for all students. It was possi- 
ble to secure all other infor mation from these 
students by scheduled make-up periods if any one 
was absent when a test or inventory was admin- 
istered. | 

Complete records and retest data were avail- 
able for 63 of the 88 students. Thirteen students 
graduated; three were dropped from college for 
poor scholastic records; three withdrew; four 
transferred to other schools, and two entered the 
armed services from the classes of the academic 
year of 1957-58. 3 

Complete records and retest data were avail- 
able for 19 of the 26 students of the class of the 
academic year of 1958-59. Two students gradu- 
ated; three withdrew; one transferred to another 
School, and one entered the armed services. I 

Complete records and retest data were avail- 
able for 82 students. These 82 students formed 
the study population, 


Population Described 


Of the 82 student study population, 12 (15%) 
were females and 70 (85%) were males. Тһе non- 
academic population was composed of 2 (4%) fe- 
males and 43 (96%) males, while the academic 
students had 10 (27%) females and27 (73%) males 
(Table I). 

A majority of the students were single. In the 
total study population 61 (74%) were unmarried, 
19 (23%) married, 1 (1%) divorced, and 1 (1%) 
widowed. Thirty-three (73%) of the nonacademic 
population were single, 11 (24%) married, and 
(2%) were widowed. Twenty-eight (76%) of the 
academic students were single, 8 (22%) married, 
and 1 (2%) divorced (Table I). 

The number of veterans was small. There 
were 24 (29%) in the study population, 14 (31%) in 
the nonacademic population, and 10 (23%) in the 
academic population (Table I). 

Students at WSCITP need 30-59 credits to be 
classified as second-year students, and 60-89 
credits to be classified as third-year students. 
Sixty-one (74%) of the total study population were 
second-year students and 21 (26%) were third-year 
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TABLE І 


STUDENTS GROUPED BY SEX, MARITAL STATUS, MILITARY SERVICE, AND 
COLLEGE CLASSIFICATION 


Students Grouped by Sex 


Total Study Nonacademic Academic 
population Population Population 
—== — pur 
Sex N % N % N % 
4 10 
Femal 12 15 2 27 
Ыз Н m 85 43 %8 21 73 
Students’ Marital Status 
А Total Study Nonacademic Academic 
шш Population Population Population 
Š 61 74 33 73 28 76 
a n 19 2s E ан A 22 
== 2 
Divorced 1 ; 1 2 0 бл 
Widowed 1 
Students’ Military Service 
Stud Nonacademic Academic 
Military ДЫн RAP Population Population 
Service 
58 71 31 69 27 73 
Nonveteran 24 29 14 31 10 23 
Veteran 
College Classification 
Stud: Nonacademic Academic 
Years of Ta ation Population Population 
Study 
0 ma 0 ae 0 um 
87 22 59 
14 39 
61 36 6 13 15 4 
21 0 -- 0 E 


> со № س‎ 
© 


162 JOURNAL OF EXPERIMENTAL EDUCATION 


students. The nonacademic were quite different 
from the academic in years of study. Thirty-nine 
(87%) of the nonacademic students were second- 
year students, and 21 (59%) of the academic stu- 
dents were in their second year of study (Table I). 

Students of the study population had primary 
majors in 10 subjects. Agricultural education 
was the most common primary major of the study 
population. Twenty-nine (35%) were agricultural 
education majors, 14 (17%) industrial arts majors, 
11 (13%) history majors, 9 (11%) English majors, 
8 (10%) biological science majors, 7 (9%) mathe- 
matics majors, and 1 (1%) in each of the following: 
chemistry, elementary education, music, and 
physics (Table II). 

The subjects in which students were majoring 
were classified into academic-nonacademic areas 
along the Hutchins' line as done in Carter Good's 
Dictionary of Education (15). Seven subject areas 
were defined within this classification. 

Academic subjects were divided into three 
areas: 


1. Language—English, French, Spanish, Rus- 
sian 

2. Science-Mathematics—Natural Science, Bi- 
ology, Physics, Mathematics 

3. Social Sciences— History, PoliticalScience, 
Geography, Sociology, American Insti- 
tutions 


Nonacademic subjects were divided into four 
areas: 


1. Arts—Art, Music 

2. Vocational Education— Agriculture, Home 
Economics, Industrial Arts, Business 
Education 

3. Physical Education— Physical Education 

4. Miscellaneous—Journalism, Speech, 
Speech Correction, Recreation, Ele- 
mentary Education 


This division into subject areas was done so 
that a better comparison could be made between 
the nonacademic and academic populations. It was 
felt that the academic students would do bet- 
ter in educational psychology than the nonacademic 
students. 

Forty-five (55%) of the study population were 
majoring in nonacademic subjects, 37 (45%) in ac- 
ademic subjects. 

The total study populationwas quite heterogen- 
eous as to the size of community in which the stu- 
dents lived when they attended high school. The 
following are community sizes: farm 36 (44%) ; 
village under 500, 14 (17%); 500-2500, 14 (17%); 
2501-10, 000, 10 (12%); 10,001-39,000, 4 (5%); 
39,001-150,000, 3 (4%); andover 150,000, 1 (1%). 
Only 8 (10%) of the students had lived in commun- 
ities of over 10,000 when they attended high school. 


The majority of the nonacademic population, 25 
(56%), have lived onfarms. Twenty-nine (65%) of 
this group have chosen agricultural education as 
their major field of study. The majority of the 
academic students, 11 (30%), came from farms, 
and 10 (27%) came from villages under 500 (Table 
Ш). 

The total study populationwas very heterogen- 
eous as to the size of high-school graduating 
class. Aminority, 17 (21%), of the graduating 
classes were over 100. The nonacademic and ac- 
ademic were similar in this respect to the total 
population with 9 (20%) and 8 (22%) respectively 
(Table III). 

The youngest student of the total study popula- 
tion was 19 years old, theoldest 38. The major- 
ity, 52 (63%), were 22 and under. 

Twenty-nine (65%) of the nonacademic students 
were 22 years of age or under, 23 (63%) of the 
academic students were 22 and under. The mean 
age for the study population was 22. 22 years of 
age. The nonacademic meanwas 22.18. The ac^ 
ademic mean was 22. 27 (Table IV). í 

The formal educational status of the parents o 
the study population was not high. Of the mothers 
5 (6%) did not finish the elementary grades; 
(46%) were elementary graduates; 18 (22%) grad- 
uated from high school; 19 (23%) attended colleg? 
but did not earn a degree, and 2 (2%) graduate 
from college with a degree. The mothers of 
nonacademic and academic students followed а 
similar pattern, Educational status of the fathers 
was different from the mothers. Ten (12%) A 
not finish the elementary grades, 47 (57%) aun 
elementary graduates, 21 (26%) graduated fro i 
high school, 2 (2%) attended college but did e 
earn a degree, and 2 (2%) graduated from goleg” 
with a degree. The fathers of the nonacadem! 
and academic students followed a similar pattern. 
More fathers than mothers did not finish the — 
mentary grades. Morefathersthan mothers eed 
elementary graduates. The number of eiie 
and fathers who were high-schoolgraduates pes 
about equal. А muchlarger percentage of mothe : 
than fathers attended college, but did TT ent 
degree. The population has come from wen Y) 
rather limited educationalopportunities (Tab 599), 

A majority of the study population, 48 (5 2d 

š £ rting. Twenty-nine (3 
were partially self-supporting. | 5 (6%) 
%) were completely self-supporting. Only The 
were completely supported by their parents. р 
nonacademic and academic students show 
asimilar pattern to the total study рер 
These students seem to have come from famili 
of limited financial status (Table VI). Bë 

In the total study population, 45 (55%) of t 
students were majoring in nonacademic areas, 

4 in academic areas А 

p Ситен intellectual, and achieve- 
ment characteristics studied included the meN 
characteristics, present or absent, in a given 51 
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TABLE II 


NUMBER OF STUDENTS ENROLLED IN MAJOR FIELDS OF STUDY 


N % 


Nonacademic Population 


Major Fields 


Agriculture 29 35 
Industrial Arts 14 2? 17 
Elementary Education 1 1 
Music 1 


Academic Population 


History 11 13 

English 9 11 

Biological Science 8 10 

Mathematics 7 8 

Chemistry 1 1 

Physics Ó5 1 
82 


Total Number 


163 
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TABLE III 
TYPES AND SIZE OF HIGH SCHOOLS ATTENDED 


Types of High Schools Attended 


Total Study Nonacademic Academic 

Population Population Population 
Classification N % N % N % 
Farm 36 44 25 56 11 30 
Village under 500 14 17 4 9 10 27 
500 - 2,500 14 17 5 11 9 24 
2,501 - 10,000 10 12 7 16 3 8 
10,001 - 39,000 4 5 1 2 3 8 
39,001 - 150,000 3 4 2 2 1 8 
Over 150, 000 1 1 1 2 0 -- 

82 45 Eki 


Size of High-School Graduating Class 


Total Study Nonacademic Academic 
Classification Population Population Population 
25 and less 19 23 10 22 g 24 
26 - 50 20 24 8 18 12 32 
51 - 75 13 16 9 20 4 Hu 
76 - 100 13 16 9 20 4 п 
Оуег 100 17 21 20 22 


g 
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TABLE IV 


DISTRIBUTION OF STUDENTS’ AGES 


Total Study Nonacademic Academic 

Age in Population Population Population 

Years N % N % N % 

19 4 5 0 -- 4 11 

20 31 38 23 51 8 22 

21 7 8 3 g 4 11 

22 10 12 3 7 7 19 

23 8 10 5 11 3 8 

24 6 7 2 4 4 11 

25 5 6 4 9 1 3 

26 6 6 2 4 4 11 

21 Ó = P € . € 

28 4 5 2 4 2 5 

Over 28 1 1 2 ü к 

Number 82 35 ы 

Mean 92. 22 22.18 22.27 

or ы 83 v i 

- 5 37 35 37 
Range 19-38 20-38 19-28 
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TABLE V 


EDUCATION OF THE PARENTS OF STUDENTS 


Education of the Mothers of Students 


Total Study Nonacademic Academic 
i i lation 
Educational POPUL a ru 
Status N % N % N % 
Not an Elementary 
School Graduate 5 6 4 11 1 3 
Elementary School 
Graduate 38 46 19 42 19 51 
High-School Graduate 18 22 10 22 8 22 
Attended College but 
did not earn degree 19 23 11 24 8 22 
College Graduate 2 2 1 2 1 3 
82 45 37 


Education of the Fathers of Students 


Educational Total Study Nonacademic Academic 
Status Population Population Population 

Not an Elementary 

School Graduate 10 12 9 20 I 3 

Elementary School 

Graduate 47 57 22 49 25 68 

High-School Graduate 21 26 12 27 9 24 

Attended College but 

did not earn degree 2 2 1 2 1 3 

College Graduate 2 2 1 2 1 3 

2 45 3" 
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uation that may influence the students’ achieve- 
ment. A potentially retarding situation may be 
present or absent but a particular student, because 
of his personal-social, intellectual, and achieve- 
ment background, may not be retarded by it. 
Even though students vary greatly in their college 
achievement, it would seem desirable to ascertain 
the personal-social and intellectual characteris- 
tics which seem to influence achievement. 

A follow-up was made duringthe 1959-60 aca- 
demic year to measure the retentionof basic facts, 
skills and concepts developed by the students and 
the effective application of these facts, skills and 
concepts. The stability of attitudes was formed 
by a retest program. Selected achievement tests 
and an attitude inventory were administered to 
those students still enrolled at WSCITP during the 
second semester of the 1959-60 academic year. 


Data-Gathering Devices and Data Collected 


Data-gathering devices for personal-social 
characteristics used in this investigation were: 
à nineteen-page data booklet to identify personal- 
Social characteristics, including family back- 
ground and current interests, the “K” score of 
the Minnesota Multiphasic Personality Inventory 
measures student emotional stability and test tak- 
ing attitude, the Minnesota Teacher Attitude In- 
ventory to measure those attitudes of a teacher 
which will predict how well he will get along with 
pupils in interpersonal relationships, and indi- 
rectly how well satisfied he will be with teaching 
as a vocation, and a ten-item attitudes scale to 
measure student attitude toward the cour se and 
method of instruction. 

Personal-social characteristics were consid- 
ered to be measured first by “K” scores achieved 
on the Minnesota Multiphasic Personality Inven- 
tory, hereafter referred to as the MMPI. Accord- 
ing to Gowan (16:208-12) the ‘‘K’’ score predicts 
teaching potential. Cottleusedthe individual form 
alternately with the group form for test and re- 
test. Bothtestings occurred within one week. 
The reliability coefficient for the ‘‘K’’ score was 
. 76 (17:5-7). 

Personal-social characteristics were consid- 
ered to be measured also by scores achieved on 
the Minnesota Teacher Attitude Inventory, here- 
after referredtoasthe MTAI. The MTAI was de- 
signed to measure those attitudes of a teacher 
which predict how well he will get along with pu- 
pils in interpersonal relationships, and indirect- 
ly how satisfied he will be with teaching as a vo- 
cation. The validity was determined by a study 
correlating the MTAI with the Pupil-Teacher 
Rating Scale, the Principal- Teacher Rating Scale, 
and Baxter's Rating Scale of Teacher's Personal 
Effectiveness. When thethree criteria were 
combined with multiple regressionweighting, the 
validity coefficient was . 60 (8:10-12). 


Personal-social characteristics were consid- 
ered to be measured also by scores on a ten- item 
attitudescale. This scale measured student atti- 
tude toward the course and method of instruction. 
The coefficient of equivalence of the scale was 
found, by a modified form of the Cronbach-Hoyt 
method, to be . 74 (12:50). 

Intellectual characteristics with which the in- 
vestigation was concerned were those indicated 
by test scores on the California Test of Mental 
Maturity Advanced 1957 S-Form, hereafter re- 
ferred to as the CTMM. The 1957 Edition of the 
California Short-Form Test of Mental Maturity, 
Advanced, is the result of over twenty years of 
research and development. Millions of individu- 
als have been tested and hundreds of studies have 
been made, either utilizing the Short- Form as à 
control or probing some aspect of its use. The 
validity of the CTMM and Short- Form is further 
verified by its high correlation withthe Wechsler- 
Bellevue. Clark reports a correlation of . 81 be- 
tween the CTMM and Wechsler-Bellevue (36:5-6). 

Achievement characteristics were considered 
to be, percentile rank, as indic ated by the stu- 
dents’ position in high-school graduating class, 
the students’ knowledge of basic facts, skills, and 
concepts to belearned in educational psychol- 
ogy and their effective application to teacher- 
learner situations, as measured by scores on 
achievement tests, and college grade-point aver- 
age, including total general education and major 
field of study. 

Three elements of the experiment, namely the 
personal-social, intellectual, and achievement 
characteristics, will be discussed in greater de- 
tail below. 

At the beginning of the semester a 19- page Data 
Booklet, a mimeographed booklet developed by the 
Teacher Research Committee of the University of 
Wisconsin, School of Education, was passedout to 
the students. They were informed that the infor- 
mation would be confidentialand would be used for 
research purposes only. Under no conditions 
would this information be availableto other teach- 
ers or employ ment officials. This was to be com- 
pleted by the next class period. 

At the end of the twelfth week ofthe semester, 
the MMPI was administered. Students were told 
that this inventory would have no influence upon 
their grades. Each one was enc ouraged to re- 
spond rapidly and honestly to eachitem. Two 90- 
minute classes were needed to complete the in- 
ventory. 

At the end of the fifteenth week of school the 
MTAI was administered. Students were told that 
this would measure attitude toward student rela- 
tionships and attitude toward teaching as a voca- 
tion. This would not distinguish a good teacher 
from a poor one, nor would the results have any 
influence upon their grades. 

Personal-social characteristics of all students 
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Were measured by aten-item mimeographed atti- 
tudes scale which was developed at the University 
Of Wisconsin. This scale was administered on 
the last day of classes. The scale measured stu- 
dent attitudes toward the course and method of 
instruction. All responses were anonymous. It 
Was hopedthat such administration would encour- 
age students to respond honestly. Students were 
Biven fifteen minutes to complete the inventory. 

Intellectual characteristics were measured 
during the tenth week of the semester by scores 
On the verbal part of the CTMM. The students 
Were informedofthe limitations and shortcomings 
Of this test when it is administeredto college stu- 
dents, 

Achievement characteristics were defined as, 
Percentile rank in high-school graduating class, 
a battery of achievement tests, a judgment test, 
and college grade-point average. 
та Percentile rank іп high-school graduatir і 

as computed for each student. This information 
Was obtained from the Registrar’s office at 
WScITp, 
- A battery of tests was usedto me 
a ent in educational psychology. All classes were 
SE Signed certain common required readings in 

ix books, The test for Educational Psychology 
Mas Educational Psychology by Lee J. Cronbach 


(9). “Five references were used which included: 
A. Fullagar 


Ti Sational Psychology by William gar 
L ; National Society for the Study of Education; 
To 198 and Instruction, 49th Paoa 27, 
; Psychology and Life by Floyd L. Ruch 2 
J: Readings Educational P s y c hology by 
a rome M. Seidman (32). The Tollowing reading 
ti, lgnments were required of all classes; the en- 
бо] Cronbach text; fifteen articles іп Coladar 22 
r ection and the same number in Fullagar; eigh! 
Via the National Society for the Study of Educa- 
lius! four from Ruch; and nine from Seidman. The 
in ü references were placed on course генет 
tes е library and wereused for instructional an 
ting purposes by all classes in common. 
ight instruments were used to measure stu- 
Achievement in educational psychology. 
ix Objective tests were used to measure stu- 
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"е final examination was a 13- item multiple 


choice test. The first 45 items were identical to 
the 45 pretest items. Twenty-eight items, cover- 
ing the required supplementary readings, were 
added. These 28 items were drawn from the pool 
of items developed by the Education 75 staff of the 
University of Wisconsin. This 73-item objective 
test was one-half of the final examination. Dur- 
ing the second semester of the academic school 
year of 1959-60, this 73-item objective test was 
administered again to those students still enrolled 
at WSCITP. Special evening hours were sched- 
uledforthe convenience of the students. Students 
were permitted sixty minutes to complete this 
part of the retest. 

The Sears Levelof Aspiration Test was admin- 
istered on the assigned Pauline Sears' article in 
Coladarci. A mimeographed study guide, which 
was developed by the staff at the University of 
Wisconsin, was given students to aid them in the 
study of this article. A week later students were 
given a ten-item true-false test. Students were 
permitted fifteen minutes to complete the test. 
During the second semester of the academic 
school year of 1959-60this ten- item objective test 
was administered againtothose students still en- 
rolled at WSCITP. 

The six weeks' test was a 44-item multiple- 
choice test developed by the staff of the University 
of Wisconsin. These items tested the material 
covered inthetextbook during the six weeks' per- 
iod and were of a technical nature. The test was 
administered at the end of the six weeks' period. 
Students were permitted fifty minutesto complete 
the test. 

The nine weeks' test was an 80-item multiple- 
choice test developed by the Psychological Ser- 
vices, Inc. These items tested four assigned 
chapters on learning inthe reference by Ruch (29) 
and were of a highly technical nature. The test 
was administered at the end of the nine- week 
period. Students were permitted fifty minutes to 
complete the test. 

The twelve weeks’ test was a 63-item multiple- 
choice test developed by the Education 73 staff of 
the University of Wisconsin. The material cov- 
ered in the textbook during this period was tested 
by these items, which were of a technical nature, 
The test was administeredat the end of the twelve 
week period. Students were permitted fifty min- 
utes to complete the test. 

One instrument was used to measure applica- 
tion of course skills and concepts to teacher- 
learner situations. The Judgment Test was a test 
devised to measure professional judgment (30) 
The coefficient of equivalence of the test, as de- 
termined by the Spearman- Brown step-up formu- 
Ја for split halves, was .76 (12:49). The data 
sheet for the test was passed out to the student š 
for home study one class period prior to the ient. 
Students were informed that the test would be 


based on data distributed but no indication was 
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given as to how the data would be used. The same 
data sheet was distributedthe day of the test with 
ten judgment items based on the data. Fifty 
minutes were given to write this test. During 
the second semester of the academic school year 
of 1959-60, this Judgment Test was re-adminis- 
tered to those students who were still enrolled at 
WSCITP. Students were permitted fifty minutes 
to complete the test. 

The grade-point average in general education, 
major field of study, and total grade-point aver- 
age was figured for these students at the end of 
three semesters in college. Data were collected 
from the records of the Registrar's Office at 
WSCITP. These grade-point averages were again 
computed during the academic school year of 
1959-60 or at the end of seven semesters in 
college, 


SECTION III 
Introduction 


THE PURPOSE ofthis study, as stated in Sec- 
tion I, is to seek information about the personal- 
Social and intellectual characteristics of students 
preparing to teach in a Wisconsin state college. 
It is hoped that the study will provide information 
not merely about the characteristics of students 
at any given time, but information about the sta- 
bility of the data collected with reference to these 
characteristics and how they are interrelated. 
The following three questions were asked: 

1. What are the personal-social, intellectual, 
and achievement characteristics of students 
preparing for teachingat a Wisconsin state 
college ? 

2. What stability does one find in such data as 
shown by a re-test program ? 

3. Are there any patterns in the abilities and 
characteristics of Wisconsin state college 
Students as shown by correlational analysis 
of test scores? 


Personal-Social Characteristics 


Personal-social characteristics were meas- 
ured by three measuring devices. 

One device used to measure the personal- 
Social characteristics of the study population 
was the **K"' score of the MMPI. These findings 
were expressed in mean scores and standard de- 
viations. 

The study population mean score was 15.79. 
Nonacademic students earned a mean score of 
16.22. The academic students had a mean score 
of 15.27 (Table VII). The highest possible score 
is 30. WSCITP students' scores ranged from 
4-25. 

The distribution of the **K" scores on the 
MMPI was shown by one-half standard deviations. 
Sixty-six (82%) of the study population fell within 


one standard deviation of the mean. Thirty-eight 
(85%) of the nonacademic students fell within one 
standard deviation of the mean, and twenty-eight 
(77%) of the academic population fell within one 
standard deviation of the mean (Table VII). 

Another device used to measure the personal- 
Social characteristics of the study population was 
the MTAI. These findings were expressed in mean 
Scores and standard deviations. 

The study population earned a mean score of 
22.87. The mean score of the nonacademic popu- 
lation was 15.33. The mean score for the aca- 
demic population was 32.03 (Table VIII). Of the 
total study population, 65 (79%) fell within one 
standard deviationofthe mean. The nonacademic 
showed greater homogeneity; 38 (84%) fell within 
one standard deviation of the mean. Twenty-seven 
(73%) of the academic fellwithinone standard de- 
viation of the mean (Table VIII). 

During the 1959-60 academic school year, the 
MTAI was re-administered to those students still 
enrolled in WSCITP to determine what stability 
might exist in the teacher-student attitude. 

The study population earned a mean score of 
31.30. The mean score of the nonacademic pop- 
ulation was 30.25. The mean score of the academ- 
ic population was 32.57 (Table VIII). Of the total 
study population, 69 (84%) fell within опе standard 
deviation of the mean. The academic showed great- 
er homogeneity on the retest with 34 (92%) within 
one standard deviation of the mean. Thirty-five 
(78%) of the nonacademic fell within one standard 
deviation of the mean. 


The scores achieved by the WSCITP students 
on the MTAI were compared with the norms of 
MTAI (8). This scoring was right minus wrong. 
Negative scores were possible. The vast major- 
ity of the WSCITP students were second semester 
sophomores during the academic year of 1957-58 
(Table I. The mean scores of nonacademic and 
academic population were below the MTAI norms. 
The standard deviations of both WSCITP popula- 
tions were below the MTAI norms (Table VIII). 

Most of these WSCITP students were graduating 
Seniors during the 1959-60 academic year (Table 
I. Themeanscoresof nonacademic and academ- 
ic appeared to be farther below the MTAI norms 
than they were during the 1957-58 academic year. 
The standard deviation was greater for the MTAI 
norms than for the WSCITP nonacademic popula- 
tion. The standard deviation was less for the 
MTAI norms than for the WSCITP academic рор- 
ulation (Table VIII). 

The last device used to measure personal- 
social characteristics of the students was 2 
10-item objective attitude scale. This scale had 
beengiventothe 114 students, the total population. 
Students did not sign their names, but indicated 
their primary major. There was no way to ident- 
ify the study population. It was therefore neces- 
sary to use the total population. These findings 
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TABLE VII 


DISTRIBUTION OF STUDENTS’ 


INVENTORY “К” SCORES 


MINNESOTA MULTIPHASIC PERSONALITY 


Total Study Nonacademic Academic 
Population Population Population 
7 g [4 
MMPI “K” Scores N % N 0 N % 
Under 5.22 2 2 0 == 2 5 
2 2 5 
5.22- 7,56 3 4 1 
(-2 S. D.) 
2 0 == 
7.57- 9.91 1 5 А 
(-1$ S. D.) 
16 5 14 
9.92-12.26 12 15 7 
(-1 S.D.) 
20 7 19 
12. 27-14. 61 16 20 9 
(-4 S.D.) 
5 11 7 19 
14. 62-16, 96 12 15 
9 20 5 14 
16, 97-19, 31 14 ш 
(+3 S. D.) А 
8 18 11 
19. 32-21, 66 12 и 
(41 S.D.) : 
4 9 14 
21. 67-24, 01 3 5 
(+13 S.D.) 
2 1 1 2 0 ‚е 
4. 02-26.36 1 
(+2 S.D.) 
45 37 
Number 82 
.22 15.27 
Mean 15. 19 16 
S.D, 4. 69 4. 18 5.18 
7-25 4 - 24 


Range 4 - 25 
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TABLE VIII 


COMPARISON OF MEAN SCORES OF WSCITP STUDENTS WITH 
THE NORMS OF THE MTAI 


Total Study Nonacademic Academic 
Population Population Population 


WSCITP Students MTAI Scores 1957-58 


Number 82 45 37 
Mean 22. 87 15.33 32.03 
S. D. 26. 47 24. 66 25. 89 


WSCITP Students MTAI Scores 1959-60 


Number 82 45 37 
Mean 31. 30 30. 25 32. 57 
S, D. 26. 63 26. 49 26. 69 


Norms for the MTAI 


Beginning Education Graduating Education 
Juniors Seniors (B. Ed.) 
Non- Non- 
Academic Academic Academic Academic 
Number 238 136 185 237 
Mean 44.1 48.3 63.0 67.8 
8. D. 27.1 29.2 33.8 24.3 
TABLE Ix 


MEANS OF WISCONSIN EDUCATION 75 STUDENTS AND WSCITP 
STUDENTS ON THE ATTITUDE SCALE 


WSCITP WSCITP 
Education 75 WSCITP Nonacademic Academic 
Students Students Students Students 
(156) (114) (76) (38) 
Mean 20. 2 26.8 25.9 28.4 
Five Methods 
Item Mean 8.7 12.2 11.5 13.4 
Five Content 
Item Mean 11.5 14.6 14.4 15.0 


e 
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were expressed in mean scores (Table IX). The 
mean score of the total population was 26. 76. The 
mean score of the nonacademic students was 25.76. 
The academic students received a higher mean 
Score of 28. 41. 
P. the five items ofthe inventory which re- 
veris to attitude toward instructional methods 
T A the course, the academic mean score of 
a p was higher thanthe nonacademic mean score 
.55. The mean score of the total population 
io 12.18. On the other five items of the inven- 
и which measured attitude toward the course, 
bes [чн meanscore of 14. 99 was little high- 
ol han the nonacademic mean score of 14.37. The 
m ofthe total population was 14. 58. Both pop- 
b lons seemed less satisfied with the methods 
be which the course material was presented than 
ith the material itself. 


Intellectual Characteristics 


a nicotine. characteristics of the study popu- 
i5 lon were measured withthe CTMM. These find- 
8S Were expressed in mean scores and standard 
€viations, 
im S mean score oí the study population was 
110. 96. The nonacademic had a mean score of 
achi 47. The higher mean score, 116.00, was 
Eee by the academic students. The standard 
h lation for the totalstudy population was 10. 38. 
y Standard deviation for the nonacademic was 
ble ae for the academic population 11. 12 (Ta- 
Achi 
hievement Characteristics 


t Achievement characteristics were considered 
Bus Percentile rank in high-school graduating 
test S, à battery of achievement tests, a judgment 
› and college grade-point average. | 
rank P measure of achievement was percentile 
Study n high-school graduating class. Of the total 
Of tp, POPUlation the mean was 57.09. The mean 
Mean Nonacademic students was 51.27 and the 
s andan. the academic students was 64. 16. The 
Dulatic deviations were as follows: total study 
and an, 9^ 21.75, nonacademic population 20. 21, 
Cademic population 21. 49. Of the total pop- 


ulati 
tion of A (69%) were within one standard devia- 
academ; © mean. Thirty-three (73%) of the non- 

r wilc and 24 (65%) of the academic population 
ble yip n one standard deviation of the mean (Ta- 
Anothe 


ar T measure was a total achievement score 
ned o 


Mester n the battery of tests given during tne se- 
“catio to the author’s studentsin a course in ed- 
10.,, 2721 PSychology: a 73-item objective test, à 
ject, 7 Objective test, a six-weeks 44-item ob- 
and at test, a nine-weeks 80-item objective test. 
tests w elve-weeks 63-item objective test. These 
Sene, dui; designed to test the students 

Nowledge of educational psychology facts 


and concepts as developed in the textbook and in 
the classroom, as well as to test the students’ 
knowledge of facts and concepts presented in the 
required outsidereadings. These tests were pre- 
sumed to have curricular validity in that they test- 
ed the common course objectives of education- 
al psychology. 

The highest possible total achievement score 
was 270. The findings were expressed in mean 
scores and standard deviations. 

The mean score of the study population on these 
270 items was 142.41. The academic mean was 
higher, 149.84, than the nonac ademic mean of 
136.31. The standard deviations are as follows: 
total study population 21. 10, nonacademic 19. 94, 
and academic 19. 96 (Table XII). 

Of the total study population, 67 (81%) were dis- 
tributed within one standard deviation of the mean. 
Thirty-eight (84%) of the nonac ademic students 
were within one standard deviation of the mean. 
Twenty-nine (78%) of the academic students were 
within one standard deviation of the mean. 


The Judgment Test was another measure of 
achievement, which was devised to measure pro- 
fessional judgment. This test was administered 
to the student population with the understanding 
that this score would be used to determine semes- 
ter grades. For all students, it was a learning 
experience and a test which would determine, to 
some extent, semester grades, The mean score 
of the total study population was -22.68. The mean 
score of the nonac ademic students was -23. 69. 
The academic mean score was -21.46. The stand- 
ard deviations were as follows: total study popu- 
lation 38. 44, nonacademic 36.18, and academic 
41. 02 (Table XII). The nonacademic population 
had more consistent intraclass student perform- 
ance than the academ ic population as shown by 
standard deviations (Table XII). 

The last measure of achievement was college 
grade-point average. The grade-point averages 
were computed for total credits, general educa- 
tion, and major field of study. These were the 
students' grade-point averages at the conipletion 
of seven semesters of college work. Grade-point 
rage was based ona four-point scale: 4 grade- 
eing given for each credit of A work, 3 for 
2 for C, 1 for D, and 0 for failures or in- 


ave 
points bi 
B work, 


completes. | 
The total mean grade-point average was higher 


for the acade mic 2.55 than for the nonacademic 
2.49. The nonacademic showed more homogeneity. 
The standard deviation for the nonacademic was 
.44 and for the acadeniic .55. Forty (89%) of the 
nonacademic and 26 (70%) of the academic were 
within one standard deviation of the mean (Table 
XIII). 

The academic population had a higher mean 
general education grade-point average of 2.41, 
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TABLE X 


ADVANCED 1957-S FORM SCORES 


Total Study Nonacademic Academic 
Population Population Population 
IQ Scores N % N % N % 
89. 61- 94.79 0 = 0 т 0 € 
(-2 S.D.) 
94.80- 99.98 q 8 5 11 2 5 
(-1 S.D.) 
99. 99-105. 17 13 16 8 18 5 14 
(-1 S.D.) 
105. 18-110. 36 25 30 15 33 10 27 
(-$ S.D.) 
110. 37-115.55 5 6 4 9 1 3 
115. 56-120. 74 16 20 8 18 8 22 
(+3 S. D.) 
120. 75-125. 93 6 7 2 4 4 11 
(+1 S.D.) 
125. 94-131. 12 3 4 1 2 2 5 
(«1$ S.D.) 
131. 13-136. 31 6 ri 2 4 4 11 
(+2 S. D.) 
136. 32 and over 1: 1 0 == 1 3 
Number 82 45 37 
Mean 112.96 110. 47 116. 00 
8. ID. 10. 38 8. 87 11.12 
Range 96-144 96-135 91-144 


= 
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TABLE XI 


Total Study Nonacademic Academic 
Population Population Population 
Percentile Rank N % N % N % 
8. 18-19. 04 3 4 2 4 i 3 

(-2 S. D.) 

19. 05-29. 91 9 11 T 16 2 5 
(-13 S.D.) 

29, 92-40. 78 10 12 7 16 3 8 
(-1S.D.) 

40. 79-51. 65 10 12 8 18 2 5 
(-$ S. D.) 

51. 66-62. 52 15 18 7 16 8 22 

62. 53-73, 39 15 18 7 16 8 22 
(+3 S. D.) 

73. 40-84, 26 7 8 4 9 3 8 
(+1 S. D.) 

84. 27.95. 13 13 16 3 7 10 21 
(+13 S. D.) 

95. 14-99. 99 0 m "p = 9 
(+2 S. D.) 

Number 82 45 on 

Mean 57.09 51.27 64. 16 

S. D. 91. 75 20. 21 21.49 

Range 11-94 14-94 11-94 
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TABLE XII 


MEAN ACHIEVEMENT SCORES 


Total Study Nonacademic Academic 
Population Population Population 


Number 
Mean 


S. 0. 


Number 


Mean 


S. D. 


Total Achievement: 270 Items 


82 45 37 
142. 41 136. 31 149. 84 
21.10 19.94 19.96 


Class Achievement-Judgment Test 
82 45 37 
- 22.68 - 23.69 - 22.68 


38.44 36. 18 41. 02 


DISTRIBUTION OF STUDENTS’ T 
SEVEN SEMESTERS I 
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TABLE XIII 


N COLLEGE 


OTAL GRADE-POINT AVERAGE AT THE END OF 


Total Study Nonacademic Academic 
Population Population Population 
College Grade- 
point Average N % N % N % 
1. 40-1. 64 0 -- 0 -- 0 == 
(-2 S.D.) 
1. 65-1. 89 7 8 2 4 5 14 
(-15 S.D.) 
1.90-2, 14 13 16 T 16 Š 16 
(-18.р.) 
2. 15-2. 39 21 26 14 31 7 19 
(-& S. D.) 
2. 40-2, 64 9 ы ; " i 9 
2. 65-2. 89 14 17 5 il 9 24 
(++ S.D.) 
6 13 3 
2. 90-3. 14 9 11 8 
(+1 S.D.) 
1 2 2 
3. 15-3. 39 3 " ° 
(+13 S. D.) А 
3. 40-3. 64 4 5 | 3 8 
(+2 S. D.) 
2 1 2 1 3 
3.65 and over š 
45 37 
Number 82 
2.49 2.5 
Mean 2.52 ° 
.44 
us 48 .55 
.81-3.91 Вы 
Range 1. 16-3. 91 1 1. 76-3, 68 
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than the nonacademic population of 2.14. Thirty- 
seven (82%) of the nonacademic and 31 (84%) of the 
academic were within one standard deviation of 
the mean. Thesetwo groups were quite homogen- 
eous in regard to distributionof grade- point aver- 
age in general education (Table XIV). 

The nonacadem іс had a higher mean major 
study grade-point average of 2.85, than the aca- 
demic of 2. 50. The nonacademic appeared more 
homogeneous in distribution of grade-point aver- 
age in the major field. Thirty-nine (85%) of the 
nonacademic population were within one standard 
deviation of the mean. Inthe academic population, 
24 (66%) were within one standard deviation of the 
mean (Table XV). 


Stability of Data as Shown by Retest 


At WSCITP, 88 students were enrolled in a 
Sophomore course in educational ps y c hology the 
Second semester of the 1957-58 academic year, 
and 26 students were enrolled in the same course 
the first semester of the 1958-59 academic year. 
Eighty-two of the 114 students were still enrolled 
at WSCITP duringthe second semester of the 1959- 
60 academic year. These 82 students were con- 
sidered as the total study population. 

Two tests and one attitude inventory were re- 
administered to these 82 students during the sec- 
ond semester of the 1959-60 academic year to 
show the stability one might findin such data. The 
product moment coefficient of correlation (Pear- 
son r) was found between the original scores and 
the retest scores. 

One test that was readministered was the 73- 
item objective examination that had been used as 
part of the final examination in the educational 
psychology classes. 

In looking at the coefficient of correlation re- 
sulting from correlating the original test scores 
with the retest scores we see greater stability 
within the nonacademic population. The value of 
r-.83 was found. For the academic population 
the value of r-.67. The value of r =. 65 was 
found for the total study population (Table XVI). 

The Judgment Test which was one of the tests 
used in grading students in educational psychology 
was readministered to those 82 students still en- 
rolled at WSCITP dur ing the second semester of 
the 1959-60 academic year. 

The coefficient of correlation resulting from 
correlating the original test score with the retest 
Scores showed greater stability within the aca- 
demic population. The value of r = .52 was found 
for the academic students. For the nonacademic 
population r = . 35. For the total study population 
r = .43 (Table XVII). 

The MTAI was used in educational psychology 
to demonstrate the different attitudes that teach- 
ers may have toward students. Items in the inven- 
tory discriminate sharply between teachers who 
have and those who do not have good rapport with 


students. The students were told to answer all 
items honestly, as this was to be a learning ex- 
perience, and the MTAI scores would not be used 
to determine semester grades. 

The coefficient of correlation between the two 
test periods was highest for the nonacademic pop- 
ulation. The coefficient of correlation was found 
to be r = . 64. The academic population hada 
much lower correlation. The value of r = .23 
was found. Forthetotalstudy population the value 
of r = . 44 (Table XVIII). 


Patterns Shown by Wisconsin State 


College Students 


Intelligence, as measured by CTMM scores, 
correlated relatively high with achievement, as 
measured by total test scores in educational psy- 
chology. Other high correlations with intelligence 
were general education grade-point average, per- 
centile rank in high-school graduating class, and 
total grade-point average. The correlations were 
higher for the academic than the nonacademic. 
The academic showed a correlation of . 71 between 
intelligence and general education. For the non- 
academic this value of r = . 34, and for the total 
population the value of r = . 60. This is to be ex- 
pected as the courses in general education use 
many of the same abilities which are needed to 
Score highona verbaltest. A commonly conceived 
idea is that the academic student usually has 
greater potential in these areas than the попаса- 
demic. 

The correlation between intelligence an d 
grade-point average in major field of study sug- 
gests heterogeneity between the nonacademic and 
academic population, The values of r are as fol- 
lows: total study population . 26, nonaca demic 
population . 44, апа the academic population ‚51. 

For the study population the correlation between 
intelligence and the Judgment Test was .21. The 
nonacademic showed a lower relationship than the 
academic ulation. " 

The nonacademic showed a higher relationshiP 
between intelligence and the MTAI than the aca 
demic population. The value r = . 50 was dd 
for the nonacademic students. Inthe cnc’ 
population the relationship was little more t 
chance. The value of r =. 02. pe 

The relationship of intelligence to the MMP. š 
“K” score was low. The highest relationship o 
found in the nonacademic population. The valu 
of r = .13 (Table XIX). | кїп 

In the total study population, percentile ran T 
high-school graduating class correlated high bes 
general education grade-point average and о ни 
grade-point average. There was a higher re = 
tionship shown in general education by the ee 
demic population, The nonacademic showed a hig 
er relationship in total grade-point average. th 
relationship between percentile rank and as 
grade-point average was lower for the total st 
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i TABLE XIV 
DISTRIBUTION OF STUDENTS’ GRADE-POINT AVERAGE IN GENERAL EDUCATION 
AT THE END OF SEVEN SEMESTERS IN COLLEGE 
Total Study Nonacademic Academic 
Population Population Population 
ped M arcae СЕЕ. 
College Grade- ; 
point Average N % N % N % 
. 87-17 1 1 1 2 0 25 
(-2 S.D.) 
1. 18-1. 48 4 5 3 7 1 3 
(-15 S. D.) 
| 1. 49-1. 79 10 12 4 9 6 16 
(-1 S.D.) 
1. 80-2. 10 23 28 16 36 7 19 
(-3 S.D.) 
2. 11-2.41 13 16 10 22 3 8 
2. 42-2, 72 16 20 6 13 10 21 
(+5 S. D.) 
5 
1 2.73-3.03 6 7 1 2 14 
(+1 S.D.) 
2 
3. 04-3. 34 5 6 9 1 5 
(+13 S.D.) 
| -- 1 
3. 35-3. 65 1 1 9 3 
| (+2 S. D.) : : 
1 5 
3.66 and over 3 £ 
45 37 
Number 82 
2.14 2.41 
Mean 2. 26 
. 54 . 63 
| S. D, .60 
1. 15-4. 00 1. 49- 
Range 1. 15-4. 00 4. 00 
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TABLE XV 


DISTRIBUTION OF STUDENTS’ GRADE-POINT AVERAGE IN MAJOR FIELD OF STUDY 


AT THE END OF SEVEN SEMESTERS IN COLLEGE 


Total Study Nonacademic Academic 
Population Population Population 

College Grade- m € 

point Average N 9b N % N % 

1.11-1.39 1 1 0 -- 1 3 

1. 40-1. 68 2 2 0 == 2 5 
(-2 S. D.) 

1. 69-1. 97 4 5 0 “a 4 11 
(-15 S. D.) 

1. 98-2. 26 16 20 6 13 10 27 
(-1 S.D.) 

2.27-2.55 10 12 6 13 4 11 
(-š S.D.) 

2. 56-2. 84 15 18 10 22 5 14 

2. 85-3. 13 15 18 11 24 4 11 
(+ S.D.) 

3. 14-3. 42 T 8 6 13 1 3 
(+ S. D.) 

3.43-3. 71 9 11 4 9 5 14 
(+15:8.0.) 

3. 72-4. 00 3 4 2 4 1 3 
(+2 S. D.) 

Number 82 45 3" 

Mean 2.70 2. 85 2.50 

S. D. .57 .48 „81 

Range 1. 19-3. 91 2.06-3.91 1. 19-3. 77 
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TABLE XVI 


STABILITY OF DATA AS SHOWN BY THE 73-ITEM OBJECTIVE TEST 


> N M S.D. 
Total Study Population 
First Testing 82 36. 83 1.21 
Second Testing 82 35. 84 6.86 
r=.65 


Nonacademic Population 


First Testing 45 35.07 6. 68 
Second Testing 45 35. 22 6. 37 
r=.84 
Academic Population 
37 38.97 7.26 


First Testing 


Ë 
Second Testing 37 36.59 TIT 


r= 67 
TABLE XVII 
f. STABILITY OF DATA AS SHOWN BY THE JUDGMENT TEST 
N M S.D. 
Total Study Population 
First Testing 82 -22.68 38. 44 
! Second Testing 82 -27. 39 40.19 
r = .43 
Nonacademic population 
First Testing 45 -23. 69 36. 18 
Second Testing 45 427.18 42.18 
r=.35 
" Academic Population 
š 37 -22. 68 41.02 
First Testing 
37 -26. 92 37. 63 


Second Testing 
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TABLE XVIII 


STABILITY OF DATA AS SHOWN BY THE MTAI 


N M S. D. 


Total Study Population 
First Testing 82 22. 87 26, 42 


Second Testing 82 31. 30 26. 63 


r=.44 


Nonacademic Population 


First Testing 45 15.33 24. 66 
Second Testing 45 30. 25 26. 49 


r-.64 


Academic Population 


First Testing 3" 32. 03 25.89 


Second Testing 37 32.57 26. 69 
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TABLE XIX 


CORRELATION COEFFICIENTS FOR INTELLIGENCE WITH SEVERAL 
ACHIEVEMENT AND PSYCHOLOGICAL SCORES 


Coefficients of Correlation 


Total Study Nonacademic Academic 

Variables Correlated Population Population Population 
with Intelligence (82) (45) (37) 
Achievement ‚64 ‚56 .66 
Percentile Rank H. S. .46 .29 .54 
Total GPA .41 .34 .56 
General Education GPA . 60 .34 71 
Major Field GPA .26 .44 .57 
Judgment Test 21 .17 .25 
MTAI .29 :50 -.02 
MMPI-‘‘K’’ Score -.02 бу, 25 

TABLE ХХ 


CORRELATION COEFFICIENTS FO 
ACHIEVEMENT AN 


R PERCENTILE RANK Н. 5. WITH SEVERAL 
D PSYCHOLOGIC AL SCORES 


Coefficients of Correlation 


i Total Study Nonacademic Academic 
Variables — Population Populatie P 
"Eur a i (82) (45) (37) 

.43 .38 

Total GPA ,40 
«51 .61 

General Education GPA .55 
.48 .42 

Major GPA “28 
‚08 ‚05 

Judgment Test +07 
MTAI 291 „86 .14 
-.10 -.04 ~ 14 


MMPI-«&" Score 
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population than the academic and the nonacademic 
populations. This suggests the nonacademic and 
academic populations are quite different. Little 
relationship was shown between percentile rank 
and the Judgment Test. The value of r =. 08 was 
found for the nonacademic. The academicr = .05. 

The nonacademic students showed a higher cor- 
relation between percentile rank and the MTAI 
than the academic. The value of r =.36. The 
correlation for the academic was r =. 14. 

The relationship between percentile rank and 
MMPI - “K” scores was little better than chance. 
The academic had a higher correlation than the 
nonacademic. The value of r = . 11 (Table XX). 

There was a higher correlation between grade- 
point average (total, general education, and ma- 
jor field of study) and the MTAI for the nonaca- 
demic than the academic students (Table XXI). 
The nonacademic showed a high negative relation- 
ship between total grade-point average and MMPI - 
“K” score. Therelationship between the MMPI - 
“K” score and grade-point average in general ed- 
ucation and major field of study is little better 
than chance for both nonacademic and acade mic 

(Table XXI). The relationship between general 
education grade-point average and the Judgment 
Test for the academic students is high. The ma- 
jor grade-point average and the Judgment Test 
show somerelationshipforthe academic students. 
This value of r -.29. А11 of the other relation- 
ships between grade-point average and the Judg- 
ment Test are little better than chance (Table 
XXII). 

The relationship between the MTAI and the 
Judgment Test was higher for the non academic 
students. All of the variables correlated with the 
MTAI showed the higher relationship within the 
nonacademic population (Tables XIX, XX, XXI). 

The academic students showed a higher corre- 
lation between the MMPI - *K"' score and Judg- 
ment Test. The value ofr -.48. The попаса- 
demic population had a correlation of .23 (Table 
XXI). 

Inthe nonacademic population the Judgment 
Test correlated .27 with the total achievement 
scores in educational psychology. The correlation 
for the academic population was .41 (Table XXII). 

The findings of this investigation were com- 
pared with those of other investigations and with 
norms given by the manual. 

Comparable results were found in a study by 
Draves (12) in an undergraduate educational psy- 
chology course at the University of Wisconsin in 
which 156 students constituted the study popu- 
lation. 

Both Draves' (12) study and this used an atti- 
tudes scaleto study student reactions tothe course. 
This scale was developed by Draves in two large 
undergraduate educational psychology classes. 
Five items ofthe scale concerned attitudes toward 
the content of the course, andfive items concerned 


attitudes toward the method of instruction in the 
classroom. 

Students did not sign their names, but indicat- 
еа their primary major. The findings are those 
based upon the responses of all students present 
the last class period of the semester prior to the 
final examination. 

The items were scored so that areaction very 
favorable to the course content or instructional 
methods employed was given four points, aver y 
unfavorable reaction по points. Five of the items 
(numbers 1, 2,6, 7, 8) were statements worded so 
as to be favorable to the course and instructional 
methods. A reply of ‘‘strongly agree’? was scored 
four points, ‘‘strongly disagree’’ no points for the 
favorable items. Five items (numbers 3, 4,5,9, 
10) were worded so as to be unfavorable state- 
ments about the course. A response of “strong” 
ly agree’’ was scored no points; “strongly dis- 
agree’’ four points for unfavorable items. The 
higher the score the more favorable the students 
attitude toward the content of the course and the 
instructional methods used. The lower the score 
the more unfavorable the attitude. A score of 40 
points was the highest possible on the total scale 
of ten items. Scores of 20 were the maximum for 
the five-item parts concerned separately with 
course content and instructional methods. Four 
points were the highest any one item could receive. 
Zero was the lowest score for each item or any 
group oí items. Р 

On the attitudes scale the mean score for ig 
versity of Wisconsin education students was 20. 
(12:153). The mean score for WSCITP students 
was 26.8. The academic students had a higher 
mean score than the nonacademic students, 28 
and 26. 8 respectively. ў 

The mean scores on the items concernin g 
instructional methods were as follows: university 
of Wisconsin education students 8.7, WSCITP a 
dents 12.2, nonacademic 11.5, and academic 
13. 4. T 

On the items concerning course content, ¢ : 
mean scores for University of Wisconsin eques ar 
students was 11.5, WSCITP students 14. 6, no 
academic 14,4, and academic 15.0 (Table D 

In comparing the mean reactions of the m e 
sity of Wisconsin education students on the ie 
items concerning instructional method and à 
items concerning course content, it was no Be 
that in each instance the mean score on eom 
content items was greater than the mean seor nd 
instructional methods. This indicates that * 
students of Draves’ investigation and this study ? 
general, were less satisfied with the methods 
which the course material was presented than w 
the material itself. ter 

At the end of the twelfth week of the semes a 
the MMPI was administered to the students 1. 
WSCITP. Scores made on the MMPI were at 5 
pared with norms (17). It was necessary to 
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TABLE XXI 


CORRELATION COEFFICIENTS FOR PSYCHOLOGICAL SCORES 
WITH GRADE-POINT AVERAGE 


Total Study Nonacademic Academic 

GPA Correlated Population Population Population 
with MTAI Scores (82) (45) (37) 

Correlation Coefficients for MTAI Score 
with GPA 

Total . 32 ‚45 ‚24 
General Education . 36 41 .19 
-19 43 .28 


Major Field 


Correlation Coefficients for MMPI - “K” Score 


with GPA 
-.48 а 
Total -.29 .08 
N" -.08 = 
General Education .09 08 
г -.03 -.09 
Major Field 2 08 
TABLE XXII 


OR THE JUDGMENT TEST WITH 


ENTS F 
COREE LATION COMENT AND PSYC HOLOGICAL SCORES 


Coefficients of Correlation 


Total Study Nonacademic Academic 
А Population Population Population 
Variables Correlated (82) (45) (37) 
with Judgment Test 
„16: * .12 
Total GPA , 12 
15 .10 .52 
General Education GPA Е 
‚17 .13 .29 
Major GPA 
.33 .27 .41 
Total Achievement 
¿ÜB 37 -.29 
MTAI Scores 
.19 -23 . 48 


MMPI- K Scores 
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minister the whole test in order to get the “К” 
scores. The scoring was sim ple. The number: 
of right responses on this part of the MMPI was 
the “K” score. The highest possible score was 
30. Therangeof scores was 4 - 25 for the WSCITP 
students. Ofthe study population, the mean score 
was 15.79. The mean score of the nonacademic. 
was 16.22. The mean score of the academic was 
15.27 (Table VII). The published ‘‘K’’ score norms 
do not seem to include college students. Gowan 
(16), however, concluded that high **K"' scores 
tend to distinguish individuals who are well ad- 
justed, who tend to be emphatic and to make good 
counselors and teachers. He further stated that 
a high “K” score is a valid and widely reported 
test indicator of teaching potential. 

The MTAI was administered at the end of the 
fifteenth week of school. It consisted of 150 items 
related to teacher-student relationships. The 
MTAI was designed to measure those attitudes of 
a teacher which predict how well he will get along 
with pupils in inter personal relationships, and 
indirectly how wellsatisfied he will be with teach- 
ing as a vocation (8). 

At thetimethe WSCITP students were enrolled 
in educational psychology they were similar to the 
beginning education juniors used in establishing 
the norms of the MTAI. For the study population 
of WSCITP the meanscore was 22.87. The mean 
Score of the nonacade mic students was 15. 33. 
The mean score of the academic students was 
32.03. The standard deviations were as follows: 
study population 26.47, nonacademic 24.66, and 
academic 25.89 (Table VIII). 

The mean score norms for the MTAI which 
were 44, 1 for nonacademic students and 48, 3 for 
academic students were for beginning education 
juniors which are well above those for WSCITP 
Students. The standard deviation norms are non- 
academic 27.1 and academic 29. 2 which are also 
somewhat larger (Table VIII). 

During the second semester of the 1959-60 
academic year, when other data were secured, 
most of the WSCITP students were graduating ed- 
ucation seniors. For this group the mean score 
was 31.30. The mean score for the nonacademic 
was 30.25, and the mean score for the academic 
was 32.57. These scores are still well below the 
junior year norms indicating that insofar as the 
test has validity WSCITP students have a some- 
less acceptable attitude onteacher-pupil relation- 
ship. The standard deviations are as follows: 
study population 26.63, nonacademic 26.49, and 
academic 26.69 (Table VIII). 

The mean MTAI score norms for graduating 
education seniors are, nonacademic 63.0, and 
academic 67.8. The standard deviation norms 
are nonacademic 33.3 and academic 24.3 (Table 
уш). 

To get ап estimate of the meaning of the differ- 
ence in attitude, as measured by scores on the 


MTAI, of the WSCITP nonacademic students and 
the norms of the MTAIthe critical ratio was com- 
puted. If one assumes that the 45 WSCITP non- 
academic students andthe 185 students (8) used in 
establishing these norms are samples of a larger 
population, the significance of difference between 
them can be tested by the critical ratio. The crit- 
ical ratio was 5.31. If the sampling assumptions 
mentioned above are granted, the difference was 
significant at the .1 percent level. We would ex- 
pect to find this difference in sampling less than 
one time out of 1000 cases. Therefore, one 
might conclude that the WSCITP nonacademic stu- 
dents are different in attitude from the MTAI 
norms. The WSCITP nonacademic students 
showed a less desirable attitude toward teacher- 
student relationship than what is shown by the 
MTAI norms. 

To get an estimate of the meaning of the differ- 
ence in attitude, as measured by scores on the 
MTAI, of WSCITP academic students and the 
norms of the MTAIthe critical ratio was com- 
puted. If one assumes that the 37 WSCITP aca- 
demic students and the 237 students (8) used in 
establishing these norms are samples of a larger 
population, the significance of difference between 
them can be tested by the critical ratio. The crit- 
ical ratio was 7.56. If the sampling assumptions 
mentioned above are granted, the difference was 
significant at the .1 percent level. We would ex- 
pect to find this difference in sampling less than 
one time out of 1000 cases. Therefore, one 
might conclude that the WSCITP ac ademic stu- 
dents are different in attitude from the MTAI 
norms. The WSCITP academic students showed 
aless desirable attitude toward teacher-student 
relationship. А 

During the tenth week of the semester, the 
verbal part of the CTMM was administered. The 
verbal part of the CTMMtested logical reasoning» 
numerical reasoning, and verbal concepts. а 
mean score of the study population as measure 
by the CTMM was 112.96. The mean of the non^ 
academic was 110.47 andthe mean of the academic 
was 116.00. The standard deviations were à 
follows: study population 10.38, nonacademic 8.05 
and academic 11.12 (Table XXIII). u 

Draves used the results of the American Coes 
cil on Education P sy chological Examination fo 
College Freshmen. This test was administere 
to all entering freshmen at the University of rn 
consin. His findings were similar to those of Uie 
Study. For his study population the mean sco 
was 119. The standard deviation was 20. The 
mean score of the University of Wisconsin educa 
tion students was similar to the mean scot © 
of the WSCITP academic students, i.e., the ac 
demic students at WSCITP are more similar t 
the University of Wisconsin education student? 
than the nonacademic students at WSCITP (Tabl 
XXIII). 
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TABLE XXIII 


COMPARISON OF WSCITP STUDENTS’ MEAN CTMM SCORES WITH 
EDUCATION 75 STUDENTS’ MEAN ACE SCORES 


Total Study Nonacademic Academic 
Population Population Population 


WSCITP Students’ Mean Scores on CTMM 


Number 82 45 37 
Mean 112. 96 110. 47 116. 00 
S: D 10. 38 8. 87 11.12 
Education 75 Students’ Mean ACE Scores 
Number 212 156 
Mean 119 119 
8. D. 20 20 
TABLE XXIV 


S OF WSCITP STUDENTS WITH MEAN 


F MEAN SCORE 
UDENTS ON THE JUDGMENT TEST 


COMPARISON O 
UCATION 75 ST 


SCORES OF ED 


Total Study Nonacademic Academic 
Population Population Population 


WSCITP - Class Achievement-Judgment Test 


Number 82 Es 37 

Mean -22. 68 -23. 69 -21.46 

S. D. 38. 44 36. 18 41. 02 
Education 75 - Class Achievement-Judgment Test 

Number 85 

Mean -12.3 

S. D: 32.3 
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To get an estimate of the difference in intel- 
ligence, as measured by scores on the CTMM, 
of WSCITP students and the intelligence, as 
measured by ACE scores, of the University of 
Wisconsin education students the critical ratio 
was computed. If one assumes that the 82 WSCITP 
students andthe 156 University of Wisconsin stu- 
dents are samples of a larger population, and if 
one assumes that the CTMM and ACE test are 
similar, the significance of difference between 
them canbe tested by the critical ratio. In mak- 
ing these assumptions it is important to recognize 
that a majority of the WSCITP students are en- 
rolled in vocational education and a small minor- 
ity of the University of Wisconsin education stu- 
dents are enrolled in vocational education. The 
critical ratio was 3,06. If the sampling assump- 
tions mentioned above are granted, the difference 
was significant at the one percent level. We would 
expect to find this difference in sam pling less 
than one time out of 100 cases. Therefore, one 
might conclude that the WSCITP students are dif- 
ferent inintelligence fromthe University of Wis- 
consin education students. The University of 
Wisconsin students are more intelligent. 

A Teacher Judgment Test was used in the ed- 
ucational psychology classes at WSCITP and by 
Draves (12:146). 

For the study population of WSCITP the mean 
Score was -22.68. The mean score of the non- 
academic was -23.69. The mean score of the 
academic was -21.46. Standard deviations were 
as follows: study population 38. 44, nonacademic 
36. 18, and academic 41.02 (Table XXIV). 

For eighty-five of the study population of 
the University of Wisconsin students who had 
taken the Judgment Test, the mean score was 
-12.3. The standard deviation was 32.3 (Table 
XXIV). The mean score achieved on the Judg- 
ment Test was somewhat lower for WSCITP stu- 
dents. Thetwo study groups had, however, about 
equal variability as expressed by standard devi- 
ations. 

Another measureof achievement used to com- 
pare WSCITP students and University of Wiscon- 
sin education students was grade-point average. 

For the WSCITP study population the mean 
grade-point average was 2.52. The mean grade- 
point average for the nonacademic was 2. 49. 
The mean grade-point average for the academic 
was 2.55. The standard deviation for the study 
population was .48. The standard deviations for 
the nonacademic and academic were . 44 and . 55 
respectively (Table XXV). 

The mean grade-point average of University 
of Wisconsin education students was 2.79. The 
standard deviation was . 43 (Table XXV). 

Accordingly, the WSCITP students achieved 
less well than University of Wisconsin education 
students or the grading standardis different. The 
two study groups showed about equal variability 


as expressed by standard deviations. 

Two sets of correlations were used to compare 
WSCITP students and University of Wisconsin ed- 
ucation students. 

One comparison was the correlation between 
intelligence and grade-point average. Draves 
study showed intelligence, as measured by ACE 
scores, of University of Wisconsin education stu- 
dents correlated quite high with grade-point aver- 
age r = . 42 (12:127). Correlation between intel- 
ligence, as measured by CTMM scores, and 
grade-point average for WSCITP students was T = 
.41 which is quite similar. 

The correlation between intelligence scores 
and scores on the Judgment Test for University 
of Wisconsin education students was r = . 14 (12: 
127). The correlation between intelligence scores 
and scores on the Judgment Test for WSCITP 
students was r = .21 which is very similar. 

The correlation between intelligence scores 
and the Judgment Test scores was lower for both 
study groups than the correlation between intelli- 
gence scores and grade-point average. 


SECTION IV 


Summary and Conclusions 


1. Among the data-gathering devices employed 
inthe study of WSCITP students was the MTAL 
For the nonacademic students the mean score for 
WSCITP students on this instrument was 15. 33 
(norm 44.1). The academic mean score for 
WSCITP students on this instrument was 32. 03 
(norm 48.3). The attitudes of WSCITP students, 
as shown by scores on the MTAI, were accord. 
ingly below the norms for the МТАІ. The MT 
was presumed to show how well teachers will £e 
along with pupils in interpersonal relationship 
and indirectly how well satisfied they will be with 
teaching as a vocation. 8 

2. When the MTAI was re - ad ministered 
years later these students were still below ше 
norms. The mean score for the nonacademic A 
dents was then 30. 25 and the mean score for th 
academic students was then 32.57. ë 

3. The two above named sets of scores y 
correlated to secure information on the stability 
of these findings. The correlation for the two wn ë 
of MTAI test scores whenthetest was taken at t ies 
two different times was . 44 for the study popu 
tion, .64 for the nonacademic students, and - М 
for the academic students indicating that the score 
on the MTAI were moderately stable. es 

4. A comparison was also made of the scor 
of the WSCITP students and the norms for t 
MTAI. The critical ratio for the mean score r 
the WSCITP nonacademic students and the norma 
was 5.31. This difference between the observe 


COMPARISON OF MEAN 
WITH THE MEAN GRADE 
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TABLE XXV 


AVERAGE OF WSCITP STUDENTS 


GRADE-POINT 
GE OF EDUCATION 75 STUDENTS 


-POINT AVERA 


Academic 


Nonacademic 


Study 
Population 


Population Population 


WSCITP Students’ Mean Grade-Point Average 


Number 82 45 37 

Mean 2.52 2.49 9.55 

S. D. .48 44 .55 

Range 1. 16-3. 91 1.81-3.91 1. 76-3. 68 
Education 75 Students’ Mean Grade-Point Average 

Number 212 156 

Mean 2,81 2.79 

S. D. .42 .43 

Range 1. 48-3. 91 2. 11-3. 76 
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mean score and the norm was significant at the 
„1 percent level. The critical ratio for the mean 
score of the WSCITP academic students and the 
norms was 7.56. This was significant at the .1 
percent level. In both the nonacademic and aca- 
demic groups the mean scores of the WSCITP 
students were below the norms. 

5. A further study was made ofthese students 
through the use of an especially constructed atti- 
tudes inventory which aimed to secure informa- 
tion relative tothe attitude of students toward the 
content of educational psychology courses and the 
instructional methods of presenting the material. 
The attitudes of these students, as shown by 
scores on the 10-item attitudes scale developed 
by Draves in two large educational psychology 
classes at the University of Wisconsin (12), were 
less favorable toward the method by which the 
course material was presented than with the 
material itself, The mean attitudes score toward 
the method of instruction was 12.18. The mean 
attitudes score toward the course material was 
14.58. 

6. Draves found the same for the attitudes of 
University of Wisconsin education students toward 
method and course content as shown by the scores 
of WSCITP students. The mean attitudes score 
toward course material was 8.7. The mean at- 
titudes score toward course content was 10, 9. 
The attitudes scores of University of Wisconsin 
students studied were, however, in both cases 
lower than the attitudes scor es of WSCITP stu- 
dents studied. 

7. The MMPI was administered to secure in- 
formation relative to certain personality charac- 
teristics. Only the ‘‘K’’ scores were used. For 
nonacademic students the mean ‘‘K’’ score ontne 
MMPI was 16.22. The mean ‘‘K’’ score for aca- 
demic students was 15.27. The ‘‘K’’ score was 
presumed to measure teaching potential. 

8. The verbal portion of the CTMM was used 
to secure information оп certain intellectual char- 
acteristics. The mean score of WSCITP students 
was 112.96. The mean score of the academic 
students was 116. Alower mean score of 110. 47 
was achieved by the nonacademic students. The 
verbal portion of the CTMM was presumed to 
measure logical reasoning, numerical reasoning 
and verbal concepts. , 

9. The mean score of the University of Wis- 
consin education students, as measured by ACE 
test scores which is a different test, was 119. It 
cannot be assumed that the ACE and CTMM meas- 
ured similar abilities except in a very general 
sense. 

10. A comparison was also made of the CTMM 
scores of tne WSCITP students andthe ACE scores 
for the University of Wisconsin Students. The 
critical ratio for the mean score of the WSCITP 
students and the mean score of the University of 
Wisconsin students was 3.06. This difference 


was significant at the one percent level, The mean 
score of the WSCITP students was below the mean 
score of University of Wisconsin students. In in- 
terpretingthis ratio it should be noted over and 
above the fact that the two tests were different, 
thatthe WSCITP grouphada much larger percent- 
age (96%) of vocational education students in the 
nonacademic group. 

11. As a measure of the achievement charac- 
teristics of WSCITP students, rankin high-school 
graduating class was studied. The mean percen- 
tile rank ofthe nonacademic students as shown by 
the student’s position in high-school graduating 
class was 51.27. A higher mean percentile rank 
of 64. 16 was shown for the academic students. 

12. A series of especially constructed educa- 
tional psychology achievement tests was used to 
secure information on achievement in educational 
psychology. The mean achievement score for the 
nonacademic students was 136. 31. The mean 
score of the academic students was 149. 84, This 
series of tests was presumed to measure student 
knowledge of basic facts and concepts in educa- 
tional psychology. | 

13. The Judgment Test was used as a measure 
of professional judgment. The mean score of the 
nonacade mic students was -23.69. The mean 
score of the academic students was -21, 68. 
Draves found a mean score of -12.3 achieved by 
University of Wisconsin education students on this 
same test. 

14. The Judgment Test was readministered 
two years later tothe WSCITP students. The 
mean score for the nonacademic students was then 
-27.78 and the mean score for the academic stur 
dents was then -26, 92. 

15. The two sets of Judgment Test scores: 
achieved by WSCITP students, were cor related ae 
secure information on the stability of these fin Е 
ings. The correlation for the two sets of Ju га 
ment Test scores when the test was taken at by 
different times was . 43 for the study population: 
.35 for the nonacademic students, and . 52 for yo 
academic students, indicating that the scores 
the Judgment Test were moderately stable. sedi 

16. The 73-item objectivetest was used ere 
the students’ knowledge of basic facts and ipei 
ineducationalpsychology. The mean score o вап 
nonacademic students was 35. 07 and the m 
score of the academic students was 38. 97. de 

17. When the 73-item objectivetest was ме 
ministered two years later the mean ee 
dropped slightly. The mean score for the nont ы 
ademic students was then 35. 22 and the 59. 
score for the academic students was then 36. ere 

18. The two above named sets of scores V ty 
correlated to secure information on the stab, yo 
ofthese findings. The correlation for the tuo 
Sets of test scores when the test was taken at "m 
different times was .65 for the study popula û 
.84 for the nonacademic students, and .67 for 
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academic students, indicating that the scores on 
the 73-item objective test were stable. 

19, Grade-point average was comp uted as a 
measure of achievement. The mean grade-point 
average for the nonacademic students was 2.49 
and the mean grade - point average for the aca- 
demic students was 2.55. Draves found a higher 
mean grade-point average of 2.79 was achieved 
by University of Wisconsin education students. 

20. In general education courses the mean 
grade-point average of the WSCITP nonacademic 
Students was 2. 14 and the mean grade-point av- 
erage for academic students was 2. 41. 

21. In major field of study courses the mean 
£rade-point average of the nonacademic students 
Was 2.85 and the mean grade-point average of 
the academic students was 2. 50. 

22. Correlations were computed to determine 
patterns of relationship between the several meas- 
ures. Substantial positive correlations were 
found among measures as follows: 

a; Intelligence and achievement in educa- 
tional psychology . 64, int elligence and 
percentile rank . 46, intelligence and to- 
tal grade-point average .41, and intelli- 
gence and general education grade-point 
average . 61. | 

b. Percentile rank and total grade- point 
average .40, and perc entile rank and 
general education grade-point average 
55. 

c. Total grade-point avera 
and general education gr 
age and MTAI . 36. 

d. Judgment Test and achieve 
cational psychology - 33. 


Conclusions 


ge and MTAI . 32, 
ade-point aver- 


ment in edu- 


a somewhat un- 
pil relationship. 
scores on the 


7 Students in this study showed 
oe attitude in teacher-pu 
Was evidenced by low mean 

to AL This undesirable attitude may be тееп 
the home and family packground. A majority 


М these students lived on farms. These рава 
ау be more autocratic than city homes Pos 


Fa this influenced the students’ attitudes. It maj 
WSC be related to the attitude of the faculty of 
SITP. In agricultural education and industria 


a. - 

Son Classes the atmosphere m2: be more Lo 

cian harmonious teacher pupil pee umm 
s 

a t rhe students at WSCITP have а 1985 ction than 


іа f instru 
tow e toward the method oF 7 ol- 
ogy. | the course content in educational psy 


The WSCITP students achieved а higher mean 


Sc > 5 

e the total attitudes scale mor an me um 
i А i ents. 

T yeh ola education S SCITP nonaca- 


Че; * intellectual level of the ҮСТІ 

level’ Stude senate than the intellectis 

Out int the academic students. AS was pol. 
he design, almost all of 


students at WSCITP were enrolled in vocational 
education. The intellectual levelof the University 
of Wisconsin was above the intellectual level of 
both groups of WSCITP students. The difference 
in the intellectual level between the WSCITP non- 
academic and academic students may be related 
to the home and family background. The differ- 
ence betweenthe intellectual level of the WSCITP 
students and the University of Wisconsin educa- 
tion students may be related to the selective na- 
ture of the University of Wisconsin. The WSCITP 
students are largely from Southwestern Wiscon- 
sin and the rural areas of the state. There are 
no large cities in Southwestern Wisconsin. The 
University of Wisconsin attracts students from all 
the states and many foreign countries. 

The University of Wisconsin education students 
showed greater achievement than did the WSCITP 
students. The higher achievement of the Univer- 
sity of Wisconsin education students may be relat- 
ed, in part, to the higher entrance requirements 
of the School of Education at the University. 

The less than acceptable attitude in teacher- 
pupil relationship of these Wisconsin State College 
students suggests a need for further study to de- 
termine the reasons for thislack. This may pro- 
duce something of value inthe planning of the pro- 
gram of teac her education with a view towards 
improving this less than acceptable attitude in 
teacher-pupil relationship. 

There seems to be a need for an evaluative 
study of the teacher education program offered at 
this Wisconsin State College in view of the intelli- 
gence level of its students. This may lead also 
to a new lookat the entrance requirements and to 
a follow-up of graduates to determine if they are 


successful. 
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THE ACHIEVEMENT of increasing control 
Over the variables with which one is concerned is 
à major goal of science. This goal has been a- 
Chieved with satisfactory degrees of certainty in 
the exact sciences. The activities of researchers 
in education and all the other life sciences have 
not achieved like powers of prediction and control. 
e reason frequently given for their less satis- 
Š ctory results is that quantities in the life sci- 
imc are resultants of so many hundreds of var- 
whi es that it is extremely difficult to determine 

É ich factor is the cause of a given observed ef- 
the, The life sciences, therefore, have based 
ir efforts on studying trends and have done so 
fener owing statistical theory and methods from 
0 ds which have found them satisfactory: finance, 
Sun. manufacturing, etc. 
th t 15 the contention of this study that even 
Sugh such logic and methods are s atisfactory 
he the purposes for which they were designed, 
pr Y have not 1ead to that degree of control and 
"diction inthe life sciences which results in the 


is s i 
this COvery of law. It is a further oe peas 


n Study that degrees of prediction an 
ach; able to those in the exact sciences can be 
leved inthe life sciences if statistical methods 


adj Ж n 
tp Sted to life conditions are utilized with data 


is reasonably complete and accurate. 


St: 
3tement of the Problem and Data Used 


* 


G š 
Onsultant, Dr. Stuart A. Courtis, 


appears reasonably accurate and sufficiently com- 
plete to merit the initiation of a scientific study of 
the effect of single variable analysis upon it. 
These data are the measurements of nineteen 
physical characteristics of boys and girls between 
the ages of four and fifteen. These children are 
from sixteen selected states and the District of 
Columbia. In addition to the physical data, other 
pertinent information has been recorded which 
make them desirable for the proposed study. 

The data were collected from 1937-39 by the 
Department of Agriculture throu gh its Textiles 
and Clothing Division in the Bureau of Home Eco- 
nomics. Conclusions from the results of the pro- 
ject were to be used by persons and firms inter- 
ested in pattern and garment construction. They 
were reported in Miscellaneous Bulletin 366 of the 
Department of Agriculture, entitled Body Meas- 
urements of American Boys and Girls. E 

For the purposes of the Bulletin, the data were 
analyzed by acceptable statistical techniques, and 
these results are also reported by the Department 
in the Bulletin. These were used to devise a pro ~ 
posed system of sizes (рр. 41-49). It is, there- 
fore, presumed thatthe sizes of children’s cloth. 
ing manufactured since the publication of the Bul - 
letin have been based upon these data. 

All nineteen physical measures have been sum- 
marized by age, state of residence, community 
size, birthplace of parents, and socio-economic 
status of the father. They are reported separately 


for girls and boys. 


Validity and Conclusion 


kk y was financed by the Educational Researc 
Professor Emeritus of 


The undertaking was carefully planned, effi- 
ciently carried out, and meticulously checked for 
validity of results. The measurements were de- 
vised by a staff of competent anthropomometrists 
and the statistical analyses were made under the 


h Fund of the University of Delaware. 


Education, University of Michigan. 
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direction of competent government statisticians. 
The results re ported included: means, standard 
deviations, tests of significance, partial and mul- 
tiple correlations, bivariate distributions with 
test of normality, coefficients of variation, coef- 
ficients of correlation and regressions of weight 
on stature. The competence of the measurers 
and the accuracy of the measurements were de- 
termined by a special investigation. 

The study is an excellent example of a survey 
of trends. The Bulletin!, however, did not deal 
with the data ona single variable basis. Surely 
such data, collected by an agency of the United 
States Government to beusedin commercial ven- 
tures, should provide an excellent base from which 
to initiate a comparative single variable study. 


Purpose 


The purpose of the present investigation is to 
be achieved by studying the effect of each of the 
variables, and the interrelationships among sev- 
eral variables, upon bodily dimensions. If such 
effects can be demonstrated in unambiguous terms 
there would appear to be little doubt but that the 
single variable methods could be used with confi- 


dence in other situations usually considered less 
objective. 


A Preliminary Investigation 


Even though the data seem ideally suited to a 
single variable study, it appeared prudent first to 
undertake a “pilot study" to determine first-hand 
the likelihood of success of a study of large groups 
of individuals representing many states and dif- 
ferent backgrounds. This pilot study is, there- 
fore planned as a test of the value of both single 
variable method and the usefulness ofthe data, as 
well as a means for devising the most efficient 
plan for carrying out the larger study should it 
prove to be warranted. 

The pilot study will attempt to apply both the 
law of the single variable and personalized statis- 
tics to a limited section of the total data and to 
contrast the results with those obtained by mass 


statistics. Both objectives will be described in 
some detail. 


The Law of the Single Variable 


The law of the single variable was first form- 
ulated by May Ayers Burgess in 1921. Monroe 
and Englehart stated in 1936 (20), “It seems rea- 
sonable that recognition of the law of the single 
variable might lead to significant refinements in 


measuring human abilities and traits. ” (p 181) 
The Law of the Single Variable as used inthis 
study is: A specific effect may be ascribed with 
certainty to a given factor as cause only when the 
effects of all other factors have been eliminated, 
or their effects allowed for in terms of their pre- 
viously determined laws of action. | 

The major flaw seen in the data in the bulletin 
issued by the Department of Agr iculture is that 
the application of mass statistics to the data ap- 
pear to have concealed the effect of many of the 
variables. Fisher states: ‘‘Grouping in effect e 
places the actual data by fictitious data place 
arbitrarily atthe central values of the groups, ev- 
idently a very coarse grouping might be very mis- 
leading. ’’ (16:52). 

This study will try to remedy that defect by 
scrupulous adherance to the law of the single Lae 
iable. The effect of each variable will be analyn 
as independently of others as possible when dea A 
ing with the data. In conducting the investigation 
of this project every attempt will be made to pro 
ceed on the following operational principles: 


1. Accept the single variable principle as 4 basis 
of analysis insofar as possible. visse 

2. Investigate all unresolved data for addition 
factors. xe 

3. When more than one means of description Y^ 
available, choose the one which describes E 
specific observable phenomenon rather than 
one based upon logical deductions from obser 
vation. lly 

4. When two means of description s eem equa st 
specific, choose the one which appears mo 
simple. ай 

5. Use mass methods of analysis only after = 
many variables as possible have been accour 
ed for. 


Philosophy of the Investigation 


Acceptance of principle 1 asa basis for apr. 
tion means in this study that whenone attemP е 
determine the relationship between one var} ' 
quantity, A, and a second variable quantity o3 
the single variable principle having been арр 


perfectly to each, the relation of A to B in 


1 е 
pairs of measurements of the two factors Wi 


found to be identical in value in every case: tha 
The single variable principle is thus eod 

guide to absolute truth under the given condi cing 

and an indicator of the degree to which it ip ad, 

achieved. When perfect accuracy is not achie 

it is an indication that further variables n pe 

removed from the quantities before they wi 


вой 


1, Throughout this study, ‘‘the Bulletin" refers exclusively to Miscellaneous Bulletin No. 366, 2 


Measurements of American Boys and Girls for Garment and Pattern Construction, Textiles and C 


joth- 


ing Division, Bureau of Home Economics (Washington, D. C.: U. S. Dept. of Agriculture, July 1941)- 


E 


°` 
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suitable for such comparison. 

When the application of principles 2, 3,4, do not 
result in perfect consistency in results, princi- 
ple 5 will be applied, but not before that point. 
The investigators are aware of the fact that a per- 
fect single variable comparison is not humanly 
possible to achieve. Their aim, however, is to 
reach as close an approximationto absolute truth 
as is possible 


Availability and Securing of Data 


Numerous texts and articles on “Human De- 
velopment” suggest that effects attributable to 
Socio-economic status are measurable (2, 15, 17, 
18). Olson (20:255) goes as far as to state that one 
investigating differences in achievement would be 
naive if he did not consider socio-economic sta- 
tus as a cause for such differences. Since most 
educational studies do not take socio- economic 
Status into account, the desire to study its effects 
grew, 

The data inthe Bulletinseemed admirably suit- 
ed to such a study. Several letters were written 
and calls made to see if the data were available. 
Finally, a visit was made to the Department of 
Agriculture to make arrangements for use of the 
data for this investigation. The inquiries were 
referred to Dr. Batchelder, Director ofthe Cloth- 
ing and Housing Division of the Agriculture Re- 
Search Service who, in consultation with others 
in authority, generously gave permission to have 

he Service Bureau Corporation duplicate for us 
the IBM punch cards upon which the data were 
recorded, 

The cards of all the children measured were 
Ordered, The cards for the girls, however, were 


11 Use and copi ined, The Bul- 
copies could not be obtained. 
d 16, 744 boys had 


parentage and 
The study 


onof all cases 


eh Onstrably inaccurate or Bulletin, 


ian These operations re 
ly 13455 from the total of 147, 088 to ap 
wer 3 000, Eventually, the cards of 

tion, received from the Servic 


aes cards indi- 
е Ode sheet accompan: 1 

n m. that all data described in the pulletin were 
at the Cards received. When t 
еге E iy of Delaware 
Em ually on the cards. TWO Ж. + 
Beart to be керегар: ards. than specific as ex 
and rea These related to pirthplace of the p E ud 

Speci Clo- economic status and will be disc! 
ically when dealing with these v 


In attempting to determine whether the specif- 
ic information as to birth of parents and socio- 
economic status could be obtained, several more 
calls and another visit to Washington were made. 
It was found that only one of the three original 
working schedules were stored in a warehouse in 
Arlington, Virginia. Their information from the 
other two had been generalized on Work Sheet I 
and the original sheets themselves destroyed. 
Consequently, the study as planned could not be 
carried out as completely as expected. 


Children Measured 


The states and the number of children meas- 
ured in each as given on page 2 of the Bulletin 


were: 


1. Alabama 9223 
2. California 5532 
3. Colorado 9258 
4. District of Columbia 5258 
5. Illinois 14597 
6. Iowa 8644 
7. Kansas 9425 
8. Maryland 6704 
9. Michigan 12210 
10. Minnesota 13235 
11. Nebraska 7354 
12. Ohio 12527 
13. Pennsylvania 8663 
14, Tennessee 6257 
15. Texas 7959 
16. Utah 9407 
17. Virginia 876 

Total 147088 


California and Tennessee Selected 


In view of the great differences in climatic and 
industrial conditions in the states, it was decided 
to limit the pilot study to two states only. Cali- 
fornia and Tennessee were selected. 

The reason for this selection was that the bodily 
dimensions of height and weight inthem was found 
to differ most widely (Bulletin, Table 63, p. 123). 


Specific Procedures 


Cards Sorted Into Packs 


Before any tabulations were made, the 70,000 
cards for boys were sortedinto packs by variables 
until groups were secured, each of which in itself 
was homogeneous withrespect to all variables ex- 
cept socio- economic status. The following are 
the variables by which the cards were sorted: 

First variable—Sex. The cards obtained a 
all of one sex, male. Number of cards, 69 os 
The exact number of the cards were not counted 
inthe first three divisions. The number E 
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here was computed from the Bulletin and is rea- 
sonably correct. These numbers are presented 
only as illustrative of the method and its results. 

Second variable—State of residence. The cards 
were next sorted by states of birth of the children. 
California and Tennessee were retained as ex- 
plained above. The two packs of cards so obtained 
numbered 10,569: California, 5002; Tennessee, 
5567. 

Third variable—Birthplace of parents. A fur- 
ther selection was made from each of these two 
packs. The birthplace of both the father and 
mother were recorded by country rather than by 
state as were the children, i.e., all parents born 
in the United States were giventhe code number 1. 
The cards of those boys whose parents were born 
in the United States were selected. This sorting 
reduced the number inthe two packs to 7982 cards: 
California, 3778; Tennessee 4204. 

Fourth variable—Community size. The cards 
of all the boys who were living in either a rural- 
farm or a rural-non-farm community were next 
eliminated by sorting from each pack and re- 
served. The two packs were now homogeneous in 
that all came from acommanity of 2500 or larger. 
Totalselect cases 4065: California 1730; Tennes- 
see 2335. These quantities as well as subsequent 
ones are exact figures from the IBM counter. 

Fifth variable-Socio- economic status. Al- 
though the Bulletin indicated that socio-economic 
status was divided into at least five categories, 
the cards were actually grouped by the Department 
of Agriculture into only three. This was not ev- 
ident from reading either the sample working 
Schedule published in the Bulletin or the code 
sheet from which the cards were punched. Pro- 
fessional, semi-professionaland skilled workers 
were grouped under socio-economic group A. 
Semi-skilled and unskilled laborers were grouped 
under socio-economic group B. Any father from 
either category who hadreceived relief was to be 
listed as socio-economic group C. The Depart- 
ment of Agriculture did not use the data listed 
under socio-economic group C. Therefore, our 
records contain only those from A and B. 

An effort was made to obtain the specific job 
classificationfor each parent. This was recorded 
originally on working schedule II and it, like other 
data on that schedule, had been condensed and 
transferred to working schedule I and then de- 
stroyed. 

No cards were eliminated by sorting at this 
time so that the total number remaining is still 
4065 but they are now infour packs: California A, 
890, California B, 840; Tennessee A, 1212, Ten- 
nessee B, 1123. Each of these packs is homo- 
geneous in itself with respect to each of the pre- 
vious variables and socio-economic status. 

Sixth variable—Age. The decision was made 
to reduce the range of the age groups as much as 
possible. The Bulletingrouped children by years. 


That is, a child who was fifteen days over fifty- 
nine months of age was listed as being five years 
old as were all children who were no older than 
fourteen days more than seventy-one months of 
age. The cards in this present study were sorted 
into half-year groups, the basic age plus or minus 
three months. That is, a five-year-old would be 
one who was not younger than fifty-eight months 
nor older than sixty-three months of age. Those 
as old as sixty-four but no more than sixty-nine 
months were placed in the five-and-a-half year 
group. This sorting produced ninety-two packs 
of cards each representing a half-year age group. 
These were twenty-three groups from four years 
to fifteen years in each of thetwo socio-economic 
groups for each of the two states. ОР f 

The heights and weights of each individual O 
the ninety-two packs were printed. 


Illustration of Packs 


By the way of illustration, the individual шр 
urements from one of the ninety-two packs ar 
shown in Table I. These data are for the Sat 
year-old boys from a Tennessee city, both 0 
whose parents were born inthis country and whose 
father is categorized as socio-economic group В. 
There aretwenty-four children inthis group. The 
names of the children are represented by a code 
number from 1-24 (first column). Columns 2, d 
and 6 show the measurements of age, height, pes 
weight arranged in order of magnitude. Since t 
measurements are inthe order of magnitude, col- 
umns 3 and 5 identify the individual. The € 
who is youngest in age (no.1) is not the ауе 
їп height. There are thirteen boys shorter than 
he. In order to trace individual relationships be 
tween age, height and weight, the code identifying 
the individuals is placed in each column. BOY st 
is the shortest in height while Boy 6 is the lighte 
in weight. 

Individual variations similar to these OCCU 
all ninety-two packs. id- 

The table is arranged to show how the nd 
scores, which are used in making comp aT n Б 
with the means in the Bulletin, areobtained. ee Ç 
and sigmas are also found. Mid-scores ar i- 
specific observable fact whereas means are od 
cal deductions from many observable facts (op 
ating principle 3, p. 194). 


rin 


Contrast Between Conventional and 
Single Variable Methods 


The mean derivedfrom the unsorted dat 
reveal only the trend of the measurements. s 
table (Table I) where every individual's per 
Scores are shown, it may seem confusing ® 
tempt to draw any conclusions from the даа, ba 
when it is remembered that the simplicity ° pj- 
means which are derived from these data 52^ 
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TABLE I 


ILLUSTRATIONS OF THE RECORDS OF MEASUREMENT OF INDIVIDUAL BOYS 
IN ONE OF THE 92 HOMOGENEOUS GROUPS, TENNESSEE, SOCIO-ECONOMIC 
STATUS, GROUP B, AGE 5.0 YEARS 


Individual Age in Code Height in Code Weight in 
Code Number Months Number Centimeters Number Pounds 
1 58 15 30 6 99 
2 58 6 32 15 99 
3 58 10 33 23 100 
h 58 21 33 1 100 
5 58 22 3h 16 102 
6 59 19 35 17 102 
7 59 7 35 2 102 
8 59 11 36 12 103 
9 59 16 36 10 103 
10 60 8 27 21 103 
ii 60 23 37 7 10h 
12 60 12 38 22 105 
13 60 17 39 20 107 
1h 60 T 39 3 107 
15 61 2 ho n 108 
16 61 13 hi 19 108 
17 61 20 li 18 108 
18 61 3 [М lı 110 
19 62 18 li 13 11 
20 62 L he 8 112 
21 63 1h n3 5 11h 
22 63 9 L5 2h 11h 
23 63 5 lib 1h 115 
2h 63 2h L6 9 115 
eee 
Mid-Value 13 60 13 39 13 107 
Range 2h 6 2h 17 En 17 
Coefficient of 185% 10% 185% 11$ 185% 16% 
Dispers on 
Mean 60.25 38.38 106.29 
888106289 
Standard Deviation 1.71 4.38 5,12 
Coefficient of Variation 2.8 
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fice the identification of the variations it is de- 
Sired to study, such detail is necessary. So far 
as means and mid -scores are concerned, to the 
degree that the distribution of the scores is sym- 
metrical, the means and the mid-scores are 
identical. But to the degree that the distributions 
are irregular, the trend revealed by the means 
conceals the distorting factors. This fact will be 
made evident many times in the discussion which 
follows. 


The Statistics Used in This Study 


Also in accordance with Principle 3, page 194 
Of this report, range (high - low + one) will be 
used instead of standard deviation as the measure 
et dispersion. In addition, a new measure, coef- 
ficient of dispersion (range divided by mid-score) 
is used in place of coefficient of variation. The 
Values for these three measures for this group 
are given at the bottom of Table I. 

. The reader should note that it is the conclu- 
Sions from these measures which will be com- 
Pared with the conclusions from the Bulletin. For 
Instance, on page 92 of the Bulletin, the heights 
Of 296 ten-year-old boys is given as 140. 80 cen- 
timeters, but these 296 boys are of all types 50 
hat the mean conceals the effects of the differ- 
ences in place of residence, parentage, commun- 
ity size and socio-economic status. The standard 
deviation in the Bulletin is 7. 13 centimeters, but 
in Table T it is 4.38 centimeters. In the present 
Study the mid-score for boys of ten years of age 
liom California of ‘American-born parents who 

Ve in an urban area and are in socio-economic 


8roup A is 139 centimeters. While the mid-score 
up differs only 1.8 
of the 296 boys, the 


of 
in th 


ations i 
b 2 Š sion may 
» but this very we X ner it is or not 


; | OCio-economi tus. 
S revealed by Ө maparisons with those of all 
except Pe. homogeneous ic. 
cio- i us. : 
S will be economi Ет coefficients of я 
Оп (range mid-score). It should be T 
pni I that the coefficients of disper де. in- 
dicate О? 10, 43, and 16. Such difference Es 
gnize that variables other than those so 
*d are operating. 


AS 


i 
gle Variable Relationship 


T i : 
Of r ar Strate a single var! 
nee е 500 the coefficients 
ac Sion i epe (Table II). 

e S fixed at six months = es 
TOup, while the mid-score for age increas 


mination 


deter 
able ion for 


from group to group. Consequently, the coe ffi- 
cient of dispersion for age steadily declines ina 
systematic manner as shown in Figure B (see 
top of next page). The reason why the coefficient 
of dispersion for ages 4.0 and 15.0 differ from 
the pattern is that these groups are not complete. 
There were no measures of children recorded by 
the Department of Agriculture who were younger 
than 48 months. This age group therefore had a 
range of only four months. The 15.0 group con- 
sisted of only two children with a range of only 
three months. Figure B is, therefore, not only 
an excellent example ofthe type of consistent pat- 
tern which indicates the achievement of a single 
variable relationship, but it is also an excellent 
example of a method of identification of causes of 
deviation from a single variable relationship. 


Appearance of Data After Sorting 
and Comparison 


The mid-scores for each age from each of the 
two socio-economic groups (A and B) from both 
California and Tennessee were found and record- 
ed (Table III). 

It was our original hypothesis that the data at 
this point would permita single variable compar- 
ison of the effect of socio-economic status on both 
height and w eight in both states. Inspection of 
these data indicate that the trends in heights tend 
to favor the California boys in socio-economic 
group A. These comparisons can be most clear- 
ly seen in examining the ratios of A to B (Table 
IV). The mid-r atio for height in California is 
1.01 + . 045 and for height in Tennessee is 1.02 + 
.092. The mid-ratio for weight in California is 
1.02 and for Tennessee is 1.06 + . 176, 

Since, however, this is a single variable study 
the acceptance of trends is not permissable until 
the search for allother possible variables has 
been exhausted. The differences in height on the 
average are less than two percent. Then, too 
there are reversals. The weights appear to dif. 
fer by a greater margin but this is less than six 
percent. These relationships are far from achiev- 
ing the required consistency of Figure B. This 
is proof that other variables are functioning. 


Coefficient of Dispersion 


It mast be remembered that the range is used 
as a measure of dispersion to insure that varia- 
tions would be revealed. Standard deviation or 
variance are considered better measures of dis- 

ersion by those who wish to eliminate the effect 
of variation due to non-typical cases. However 
the coefficients of dispersion are used purposely 
in this study to determine whether or not more 
variables are operatingthan those originally per- 
ceived. Please note that range is defined as H - 
L. + 1 (Table V). In mass statistics the conven- 
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TABLE II 


COEFFICIENTS OF DISPERSION IN A SINGLE VARIABLE 
RELATIONSHIP 
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TABLE III 


MID HEIGHTS AND MID WEIGHTS OF BOYS BY AGE, STATE, 
SOCIO-ECONOMIC STATUS A AND B 


ú@— ИНОНИ‏ چ 
HEIGHT WEIGHT‏ 


4.0 106 10% 103 100 h2 38 3 

h.5 106 107 107 102 38 lo 36 > 
5.0 113 106 107 1% L5 ho 39 39 
5.5 i2 333 113 109 L2 hh hh hi 
6.0 117 116 lli 11i ho  h8 h2 ШП 
6.5 120 119 119 117 50 51 L8 L6 
7.0 122 121 119 18 53 51 50 48 
7.5 125 1025 1205 123 5 56 52 50 
Bo 128 12; 126 126 60 56 55 52 
8.5 131 132 130 127 60 63 59 55 
9.0 13h 13 133 130 61 65 б % 
9.5 127 136 13h 132 67 66 6l 59 
10.0 139 137 138 135 74 69 66 6 
10.5 13  1h2 139 135 T9 75 70 68 
11.0 145 1 142 2130 81 7h n 68 
11.5 шт ща 112  1h2 Bl 8h 72 72 
12.0 1h8 ша 146  1h5 88 85 16 15 
12.5 152 150 lh9  1h7 9l 90 80 81 
13.0 155 153 19 19 92 93 в в 
13.5 156 15 15 152 97 106 9h 88 
1.0 162 101 161 155 108 108 10 89 
14.5 162 165 165 57 119 117 m oT 
15.0 162 166 163 170 120 121 110 122 


RATIOS MID-MEASURES OF SOCIO-ECONOMIC GROUP A TO B, с/т 
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TABLE IV 


ج بے 


Celizornia 


Tennessee 


ag Hb. Wb. Ht. Wt. Age 
1.0 1.013 1.1053 1.0300 1.0882 &.O 
1.5 .9906 .9500 1.0190 1.0270 1.5 
5.0 1.0660 1.1250 1.009} 1.0000 5.0 
5.5 1.0090 .95h5 1.0367 1.07;2 5.5 
6.0 1.0086 1.0208 1.0000 „955 6.0 
6.5 1.008 „980l 1.0171 1.035 6.5 
1.0 1.0083 1.0392 1.0000 1.0417 7.0 
155 1.0000 1.0000 1.0163 1.0530 Tus 
8.0 1.0078 1.0714 1.0000 1.0577 8.0 
8.5 992k, .952l 1.0236 1.0727 8.5 
9.0 .9926 1.0308 1.0230 1.071 9.0 
9.5 1.0074 1.0454 1.0152 1.0887 9.5 
10.0 1.0146 1.0725 1.0222 1.0176 10.0 
10.5 1.0070 1.0533 1.0296 1.0769 10.5 
11.0 1.0281 1.0916 1.0113 1.011 11.0 
31.8 .9932 .9613 1.0000 1.0000 11.5 
12.0 1.0000 1.0353 1.0069 1.0133 12.0 
12.5 1.0133 1.0hl 1.0136 .9877 12.5 
13.0 1.2131 9892 1.0134 1.0875 13.0 
13.5 „9936 .9151 1.0132 1.0682 13.5 
3o 31.0062 1.0000 1.0387 1.1798 14.0 
11:5 19848 1.0171 1.0510 1.1340 11.5 
1510 .9759 .9917 .9588 .9016 15.0 
2 4.092 1.06 +.176 


.01 +.015 1.02 + .103 1.0 


Mid Ratio 1 


тыюны 
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TABLE V 
HEIGHT AND WEIGHT 
SOCIO-ECONOMIC GROUPS A AND B IN 
ma ТҮШТҮ 
тїт EN ___ 
TENN. CAL. ТЕҢИ. 

ger Б mE cf xr: 
1h 16 17 5 15 
ў 8 m E 15 19 13 2 1 
s. m i 16 2) 3h 23 20 
= 21 26 31 30 21 28 2h 
d 18 1i 23 2 2h ir 31 
2 2 2 23 
pa A A а зә 33 28 21 
А 93. 36 20 26 33 29 
с A 31 26 ат 31 51 53 
2 e 28 30 п 52 do hé 
ep 21 29 10 36 37 he L7 
. 2 oh 2h jo 39 l2 57 
20 та 31 38 52 l8 62 73 
2 R n 31 70 61 38 55 
2 2 30 A 67 39 73 60 
26 95 зә 30 ç B6 5 15 
27 3 3 36 70 L5 79 60 
30 Ж в 22 6 60 67 85 
3 2 з 3 10 59 73 99 
B» 3j hO 69 95 86 6 
EX os 6 38 o 83 88 77 
B 38 30 36 88 8 70 51 
vd 12 P 63 Т m B 
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FIGURE B 


COEFFICIENTS OF DISPERSION IN A SINGLE VARIABLE 
RELATIONSHIP 


tional index of dispersion is the coefficient of var- 
iation which is the standard deviation divided by 
the mean. Inthis study, range divided by mid- 
measurement is used (Table VI). This measure 
has been termed coefficient of dispersion to dif- 
ferentiate it from coefficient of variation. The 
analysis of trends by group comparison proves 
that even after careful sorting into ninety-two 
homogeneous groups interms of the foregoing six 
variables, the comparison of trends from each of 
the ninety-two groups confirms very exactly the 
data published in the Bulletin (Table 66, p. 129). 
Up to this point, therefore, neither method can 
be considered superior except that the single var- 
iable method directs attention to factors that other- 
wise are likely to go unnoticed. 


Size of Group as a Heretofore 
Unrecognized Variable 
LSBnized Variable 


One variable that might be effectingthe data is 
size of the groups. It was noted when sorting the 
cards thatthere were wide variations in the num- 
ber of cases in each ofthe ninety-two groups (Ta- 
ble VII). It appears obvious that the size of the 
group must effect the dispersion of the distribu- 
tion once a question about relation of size to dis- 
persion is raised when the distributions are 
drawn. 

By way of illustration, a sample of 100 cases 
(Figure C) is randomly selected from a distribu- 
tion of 150 cases (Distribution A). Distribution B 
would be expected to have the same central tend- 
ency and dispersion as did A andas would the re- 
maining cases making up Distribution C (law of 
large numbers). These distributions are obvious- 
ly different in one characteristic: The ratio be- 
tweenthe altitude and the base line has been altered 
This relationship can be maintained only if the 
dispersion and, therefore, the dispersion index is 
reduced. The degree to which the shape of the 


эо 140 40 (RO 130 | 


15.0 


jets be 
distribution effects its characteristics should 
studied. 


Supplementary Investigation 


To control variations insize, a sample 01 
forty-five individuals wastaken from the par tal 
Growth Data. Since these data are langin age 
in character, the size of the group at each ie i 
remains constant at forty-five. This € in 
homogeneous with the A socio-economic Lp 
our study: all boys, all from one state, al tage; 
one city, all from Northern European per age 
and with the same socio-economic status e df by 
except that age groups are by years instead б o 
half-years (Table VIII. Note that coefficien ! 
dispersion for the various ages are considere а 
less variable than those of the previous apis 
cause of the consistency in the size of gro one 
There is still considerable variation, a p 
In terms of our single variable theory this m ize 
that still another variable previously unrecogn 
is operating. 


Cyclic Maturation: A Variable 
—— maturation: А Variable 


caused 


The new factor appears to be variation the ex- 


by differences in cyclic maturation. Since ter 0 
istence of cyclic maturation is still a mat ent- 
controversy for some researchers, a repres clic 
ative bibliography of research establishing © 
maturation is appended marked with an asteri 
The length of this bibliography could be gr 
extended. 

By way of illustration, the curve of the £T 
of an individual boy was drawn (Figure D). o from 
the mid-individual at age seven (case 102077 Ay 
Table VIII) and is taken as the standard chil ease 
other measurements are comparedto his. P idly 
note his pattern compared with that of a гар boy 
growing boy (case 3111) and a slowly growing 
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TABLE VI 


COEFFICIENTS OF DISPERSION OF MID-HEIGHTS AND MID- 
WEIGHTS OF THE 92 HOMOGENEOUS GROUPS 


WEIGHT 
AGE CAL TENN 

B A B A 8 
L.0 iX? 427 «08 1h .38 1h lili 
h.5 12 .12 .1h 15 50 53 .38 
5.0 19 „17 .13 15 .53 33 .51 
5.5 di 4923 08 71 .6h 459 
6.0 „26: „Д0 20 .37 „о .70 
6.5 .33 23 .18 21 52 31 .50 
7.0 .2h  .22 .18 .25 Th .56 .50 
7.5 .15  .15 18 29 .36 63  .58 
8.0 AB a17 ¿25 21 78 «93 1.02 
8.5 JR „20.52 2h —.52 .13 — Bh 
9.0 419 91.92 لك‎ En .70 By 
9.5 .20 .16 .18 .18 58 .66 97 
10.0 .20  .20.92 .28 O .9h 1.16 
10.5 27 8.22 «423 89 5 85 
11.0 48 .15 .21 .22 83 1.03 .88 
11.5 +18 .20 .23 „21 .69 КП 63 
12.0 .20 „93 „2 25 .80 1.04 80 
12.5 „20 „20 „27 „22 э КП .68 
13.0 ‚139 223 .25 .25 1.09 8& 1.21 
13.5 221 „2202 .26 «Та .91 Min 
14.0 И Е) 25 91 КУП 87 
1.5 4. 421 38 23 7h . 6l 53 
15.0 ol, .09 .18 .05 .53 .66 ЛЖ 


ТАВГЕ УП 


DISTRIBUTION OF THE NUMBER OF CASES IN EACH ОЕ 
THE 92 HOMOGENEOUS GROUPS 


CALIFORNIA TENNESSEE 
Size —  — =- 
90 А Р A В 
80 а 
10 0 П 
E E 6 2 
50 B + 3 5 
ho 6 10 " a 
ae $ 6 2 0 
20 0 L i 4 
10 2 z А 
И ی د‎ 1 1 
23 2 
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TABLE VIIT 


HARVARD GROWTH STUDY HEIGHTS OF FORTY-FIVE 
SELECTED INDIVIDUALS 


Ages 
Case No. 7.0 8.0 9,0 10.0 31.0 12.0 13.0 14.0 
153h- II 1 2111 1211 1265 1319 1362 1480 1530 1620 1 
1001-III 2 1120 1182 1229 1280 1327 1382 138 1493 2 
s42- I1 3 1123 1165 1217 1250 1315 1365 1165 1553 3 
16-111 h 1129 1177 1221 1275 133, 1366 1393 1113 n 
626-111 5 1129 ini 21236 1280 1331 1376 1432 1513 5 
599-111 6 1129 1171 1210 long 1275 21318 1350 1397 6 
162-101 7 abs 1202 123 128: 1330 21380 1052  15h9 7 
1882- I1 8 1150 sh 23; 1284 1334 136? 1421 Ahh 8 
2838- II 9 1152 1221 126! 1312 1351 1h03 yh 1522 9 
1265 1333 1372 2 1455 10 


792-1111) 1156 1196 1219 
is-nuii 157 1219 1274 3h Ahh Дз 1h80 150 H 
2848-11 12 1160 1225 1289 1339 1390 1133 1482 1545 12 
177L-II 13 1162 1205 1251 1297 1336 1377 1424 1055 13 
P 288-III. 1163 221 1277 1335 1385 ШШ 1191 
648-11 14 1168 1216 1275 1322 1371 212 1157 182 25 
791-II116 1177 1217 1270 136l, 0з 116 1490 1576 16 
957-1111] 1179 21206 1308 1367 Шо Щ6 1523 1583 17 
227-II 18 1180 120 1292 1356 1411 1172 1526 1607 18 
1з21-11119 21199 1759 1313 1372 11 167 1538 1628 19 
1246-0 1200 1273 1321 1372 1h13 1h66 1523 1614 20 
196o-II121 120  12hh 1302 1364 42h 1433 1530 1587 21 
2998-1! 22 12 12h7 1310 1350 112 1565 163h 1662 22 
1020-11 1.23 120h 1269 1322 1372 1h23 1180 1561 1660 23 
1086-12 1206 12354 1311 ы 2012 56 1503 1534 20 
f 717-1125 1206 1250 1311 1356 339, 31 Т? 1532 25 
1696-11126 1206 1271 1322 1368 щт 1455 150 1549 26 
Socr; i2 lsk 1315 1369 т qe mn ae A 
313 13 9 2 
1211 1259 1313 5 Mr. И E WE 


1h50-II 28 ОО ee, E 
31- 211 8 3 6 1591 
ee oe 121), 1285 1331 1391 ШШ iso 1582 1686 30 
I 1253 21305 1355 ШО. 1032 1080 1516 31 

60 323 175 155 160b 32 


1276-III31 1218 2 322 
1260 1218 1372 


| с 
lo-1D9 2203 Z 25020 2550 16% 33 


1399 ИЛ 
и hS Ti їз 1568 3L 


u83-II 33 21203 1221 
7-1113 3 1283 1324 1374 1523 1 
| Tame 1227 2278 2342 23828 136 ther 21529 1575 35 
6971135 1200 1299 36h 220 mH 15.3 189 E 36 
306-1113] ; £ asl 1397 93 2 3 
још 00 i» D^ gos шщ ШШ 1520 1593 38 
3 1570 1568  175h 39 


1687-11 38 1253 > 15 
3 63 1330 1393 115 9 7 ? 
rea a rn 1337 1hoh 1458 1520 1571 1610 1751 io 
"—— P" ОП Jaa 66لا‎ 1565 160 1715 1727 Ш 
“orare 12801 1329 юз 56 1513 1556 1620 192 12 
1313-IIIh3 1292 1367 1411 1h73 1528 0 i 1 785 is 

2-111] 361 118 2 566 1610 1 t 
à É 1577 1665 1738 1805 ls 


232-I11hh 1302 3 Le 
1129211 05 1335 10 wwe? 1523 

R 225 2h? 258 216 302 318 379 hoe 
ange 5 2 2 

p.e d.t 18.69 19-15 19.52 20.12 21.22 93.51 24.28  2h.6h 
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(case 1774). The beginning-of-the- cycle change 
is clearly evident in both the upper and lower 
curves. The rapidly growing boy's height accel- 
erates at ten years of age and begins to level off 
at twelve years. The slowly growing boy does not 
begin to accelerate until twelve years and then 
begins to level off by thirteen. The mid-individ- 
ual has not begun to level off at fourteen years. 
Note, also, the changing ratios ofthe measure- 
ments of each of the boys to the mid-boy given at 
ages eight, ten, twelve and fourteen. The de- 
crease in ratio of Case 1774 indicates only that 
his growth has been less rapid up to that point 
than has that of the mid-boy. 


Consistency of Growth Patterns 


The ratios of the heights of each of the other 
forty-four individuals to the mid- individual are 
given in Table IX. The consistency with which 
the patterns of these boys paralle 
noteworthy. One of the most stri 
that of the forty - fifth boy. The differences be- 
tween each boy’s ratio and the mid or standard 
boy from one year to the next have been comput- 
ed and distributed (Table X) so that a picture can 

° obtained of the relationship of the height- 
growth pattern of these boys to each other. 

Of the 315 possible comparisons; thirty-four 
9r over 10% show no difference whatsoever. An 
additional 113 comparisons (47%) range from zero 
9 plus or minus five-tenths of one percent. A 
Tange of variation no greater thanone percent in- 
cludes sixty-seven percent of the cases. Sucha 
Variation at eleven years of age represents a 
change of up to fourteen millimeters or approxi- 
ele one-half of an inch. There are, however, 
Variations up to as much as six percent. Approx- 
“mately seventeen percent of the ratios vary as 
Much as two percent of their m agnitude. The 


"gest individual variations begin at twelve years 

ыч or about the time that the cycles begin to 
A б e median differer 

de eroe e E) beneath 


taken | : 
fro i wn (Figur 
e m Table X is sho Piin from Table 


Coefficient dispersion 
Уш. Thi Sr rg indicates that the relator 
Shi is summary indica 
9 between them begins to change at eleven y 

Бе. The fact that eleven | E 
€ onset of adolescence 10 Lone 
indicates that the cycle of maturation 1 
Table. The cycle of maturation, à 

вдо iE phenomenon, has heretofore 
nized as a variable. а 

n order to see this from still another | e e 
Com the three-c ycle exponential equatio hee 
the pu ed (Figure D). It describes the oe ad 
c e rn 1d-individual almost exactly: The S! of 
twenty 9 is the last point. pego 
ent “Six millimeters accounts 10 Van 
tor te difference between the meán and median € 
t the twelve points of the curve. 


1 the mid-boy is 
king of these is 


Isochrons (Naperian loglogs to the base of e and 
converted to remove negative numbers) are used 
to make the computations easier. 

Note that three rather than two cycles are re- 
quired and that the increase in rate of growth of 
the mid-boy during the third cycle is unusually 
great. 

The ratio of 100 is used to describe the mid- 
boy at all points. The fact that almost all other 
ratios decrease suggests that the mid-boy’s growth 
has speeded up and they therefore appear not to 
be growing as rapidly as he. The equation con- 
firms this. The choice of this boy as a mid-child 
was not an ideal one from more than one point of 
view. Standard children should be selected who 
are representative of each of the important vari- 
ables. Until they are, however, selection of the 
mid-child of the distribution for the standard 
suits our purposes adequately. 

The fact that the Harvard Growth Data are long- 
itudinal makes it possible to correct for matura- 
tion muchinthe same way that altitude is correct- 
ed when dealing with air pressure. Although it 
may be possible to account for m aturation in 
cross-sectional data such as that collected by the 
Department of Agriculture it could not be done 


within the scope of this study. 
An Attempt to Control Size 


Previous discussion has shown that when size 
is held constant the dispersion decreases. There- 
fore a further attempt was made to determine the 
effect of group size using the Department of Ag- 
riculture data. 

A card was made for eachof the forty-six com- 
socio-economic group A and B giving 
the size of group, as well as the mid-values and 
ranges of both heights and weights. These forty- 
six cards were then paired by age and state of 
residence. The pairs were then arranged in or- 
der of size of group and distributed by the differ- 
ences in size (Table XI). It can be seen from this 
comparison that as the differences in size between 
the groups being compared increase, the range 
tends to increase also. Within the limits of the 
number of cases, the trend tends to be 1.01. It 
is probable, therefore, that if it were possible to 
bring the size ofthe group under exact control 
that there would be no difference attributable to 


socio-economic status. 


parisons of 


Conclusions and Recommendations 


Conclusion as to Effect of Socio- 
economic Status 
economy" v 


The effort to deter mine the effect of socio- 
economic status on height and weight with the De- 
partment of Agriculture data is, in the last anal- 
ysis, impossible in this study for two reasons: 
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TABLE IX 


RATIOS OF THE HEIGHTS OF LL INDIVIDUALS TO THE MID-INDIVIDUAL# 


7.0 8.0 9.0 10.0 11.0 12.0 13.0 
1 92.28 95.13 95.69 96.11 95.71 100.00 98.01 
2 93.02 93.1, 92.91 93.29 93.25 93.38 92.12 
3 93.23 91.80 92.06 91.98 92.11 92.23 33.85 
h 93.77 92.75 92.36 92.93 92.3 92.30 89.2h 
5 93.21 92.28 93.49 93.29 93.75 92.97 91.]h 
6 93.71 92.25 91.53 90.96 89.60 89.05 87.12 
7 95.38 91.72 91.02 93.51 93.46 93.24 95.02 
8 95.51 93.30 93.57 3.59 93.75 92.52 91.03 
9 95.68 96.22 95.61 95.63 91.9 9h.80 92.50 
10 96.01 91.25 9l .l8 93.86 93.68 92.72 90.45 
TI 96.10 96.06 96.37 95.77 96.56 96.15 9.81 
12 96.35 96.53 97.50 97.59 97.68 96.82 3h. 9h 
13 96.51 94.96 91.63 91.53 93.89 PERI 91.22 
1h 96.59 95.43 96.60 97.32 97.33 97.57 95.32 
15 9 96.hh 96.36 96.35 95.11 93.3h 
16 96.07 99.12 98.59 97.70 95.15 
17 98.56 99.64 99.09 98.99 97.57 
18 97.73 98.83 99.16 97.146 97.76 9 
19 99.32 100.00 99.09 99.12 98.53 98.07 
20 99.92 100.00 99.36 99.05 97.51 97.23 
21 98.Ll 99.42 100.07 95.82 98.01 95,60 
22 99.08 98.40 99.23 105.71 101.68 100.12 
23 100 100 100 100 
(1322) (1480) (1561) (1660) 
99.17 98.38 96.28 92.1 
99.17 96.69 94.75 92.29 
100.00 98,38 96.28 93.31 
99.17 100.01 102.24 102.66 
99.32 99.91 98.0 97.77 
100.61 98.92 96.18 93,13 
100.91 101.62 101.35 101.57 
98.71 5 96.76 94.81 91.33 
99.70 109.00 100.00 99.66 98.27 96.63 
101.74 101.97 101.55 101.19 99.30 96.75 
L 102.33 101.10 100.15 100.15 100.00 95,90 96.93 9l.li6 
25 102.74 100.71 101.51 100.73 100.91 100.07 97.95 91. 88 
26 202.99 103.18 102.50 103.65 101.26 103.52 103.01 
21 103.16 01.82 101.62 100.88 98.72 95.30 
38 10.07 101.90 100.77 99,50 97.37 95.96 
39 105.32 105.06 106.98 106.85 105.66 
D 106.27 106.82? 106.35 105.5 105.18 
“1 106.85 109.87 10h.0h 
2 106.12 103.78 101.93 
hà 107.3 108.97 107.52 
ТЕ 208: 103.14 103.01 
4 111.01 


111.31 108.73 


*The mid-individual ratios are given as 1,90 
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TABLE X 


NDIVIDUAL DIFFERENCES IN STATUS INDICIES 
T DD INDIVIDUAL TAKEN AS STANDARD (100) 
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FIGURE E 


RELATIONSHIP BETWEEN MEDIAN DIFFERENCES IN STATUS INDICES AND 
COEFFICIENTS OF DISPERSION FROM TABLE 
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TABLE XT 


DISTRIBUTIONS OF THE SOCIO-ECONOMIC RATIO A TO B IN HEIGHT BY 
DIFFERENCES IN THE SIZE OF THE GROUP FROM WHICH THE RATIOS 
WERE DERIVED 


Ratio Exact n4 3 


үг 
o 
"S 
ы 
со 
m m pU mp 


Differences in Size 


1-10 11-20 21-30 31 plus 
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TABLE XII 
WEANS AND THEIR RATIOS OF SOCIO-ECONOMIC 
GROUP A to B 

nd cas ORI HE енш 

HteA Ht.B Ratio Н.А Ht.B Ratio 

No. : 

1.018 117.30 115.78 1.0131 

6. 120-52 ps 1216 123,9} 121.78 1.0178 
js wt 190,95 968. 298 126.83 1.0207 
Шы Кы ао ыы аиы шы 
2+ 13h.13 1388; 2 138.35 136.97 1.0107 
10. МУШ — ms, 1:000 — 1847 141.00 1.0068 
n 19.36 10% WM 146.010 1.0123 

156. 1-080 153.20 150.92 1.0151 


13; 161.40 157.13 1.0272 
16.00 s 
1.01 
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1. Ideal sampling methods could not always be 
followed inthe collection of the data (Bulletin, 
р. 3). The selection depended upon more than sta- 
tistical considerations. That is, the factors op- 
erating prevented a representative sampling. 
This fact is born out by the variability of the co- 
efficients of dispersion. 

2. The socio-economic classes are grouped 
which tends to destroy their effect. 


Comparison of Results of This Study with 
Those Obtained by Department of Agriculture 


The ratios of height measurements A to B ob- 
tained from the group data in the Bulletin (Table 
63, p. 123) were calculated (Table XII). The find- 
ings of the single variable method here also agree 
very closely withthe conventional method in which 
no attention is paid to the operation of variables 
inthe results. Thus, the single variable method 
can be considered no less adequate or meaningful, 
The single variable method in addition has pro- 
vided 1) a muchless complex procedure, 2) twice 
as many comparisons for additional corroboration 
of results between the two states, and 3) a means 
for determining what variables are causing the 
differences. 


A Further Supplementary Study 


The supplementary study made with the Har- 
vard Growth Data indicates that a further study is 
feasible with a minimum of time and expense, 
This study can be made with two groups alike in 
size and maturation in addition to the variables 
dealt with inthis study. The groups will differ 
only in socio-economic status. The Harvard 
Growth Data although thoroughly collected and re- 
ported represent only a small sampling within a 
single state. 


Avenues for Further Investigation 


The observed differences in the Bulletin in 
terms of socio-economic status and in terms of 
norms or standards are imperfect because of the 
possible effect of many other variables for which 
evidence is already in existence. In considering 
these variables it appears profitable to begin with 
those which certainly effect the relation of the 
means from state to state and probably effect al- 
sothe specific determination of socio-economic 
status. 

In available geographic references it is Shown 
that Tennessee is onthe average 1000 feet higher 
than is California. In terms of the general trend 
of wind and clouds, California is exposed to moist 
air blowing across it from the Pacific while Ten. 
nessee is an inland state. California has on the 
average considerably less precipitation and sev- 
eral hundred hours of sunshine per year more 


than does Tennessee. The effect of these differ- 
ences may be appearing in the data. The single 
variable method gives promise of identifying any 
such effects providing, of course, that the basic 
data are an accurate representation of reality. 
At least three other variables of generally ac- 
knowledged importance come to mind: 1) The av- 
кс salary and average food consumption are 
very different in these states. 2) A sampling of 
the original working schedules collected by the 
Department of Agriculture shows that in Tennes- 
кы both parents of over eighty percent of the chil- 
ES Were born in that state while in California 
aes than ten percent of the children had parents, 
esi whom were born in that state. 3) Ethnic 
en could also be acontributing factor to differ- 
ces in bodily dimensions. 
Е Socio-economic groups А and B from 
mas =. are compared with the corresponding 
are ipee Tennessee, the California results 
the нЕ shown to be superior—probably from 
these а of factors just listed, but possibly 
авы у factors may have an effect upon socio- 
study M Status. It is beyond the sco pe of this 
investigate the effect of such variables. 


Summary 
—À 


T sate variable method is an effective 
ables, ang Osing previously unrecognized vari- 
mining the a far as the data permits, of deter- 
2. The an ationship between them. 
it achieves i variable method is simpler, yet 
complex ачри d results to those secured by 
3. The созу tistical analyses. 
tistic for the 1сіепі of dispersion is a useful sta- 
4. It is Pb aed d of discovering variables. 
facts for logic 5 le to substitute observations of 
9. Group as deductions from mass data. 
iables which Ai and cycle of maturation are var- 
measurements ay effect any mass study involving 
controlled, Of children in which they are not 


LA — 

this study js ali zation supported by the activity of 
both a ae that the single variable principle is 
ditions and ар Salute truthunder the given con- 
is bei n indicati which it 
15 being obtained, ation of the degree to whic 

No е use of à š " К 

this stud Of the single variable technique in 
that wit Y Shows that it is not too much to expect 


of data pus factory care taken in the collection 
is feasib] © discovery of law in the life sciences 
Recommendations 

The Ре 
termine Hout goal of the pilot study was to de- 


Study of y likelihood of success of the proposed 
partment ut Дев, The basic data from the De- 
9 dete = Agriculture is judged to be inadequate 

mine the effects involved as had been 


DeLONG 


hoped and for the reasons shown. Therefore, it 
is recommended that the sec plaut bee data 
i iable studies not be attempted. 

шоо rth er recommended that the Harvard 
Growth Data be used for a single variable study 
of the effect of socio- economic status within a 
single state and that a study similar to the pres- 
ent one be made. The data on bodily dimensions 
and mental development are available on campus. 
The expense would therefore be eed d miaon 

The findings from such a study plou s vue 
other things, enablethe planning of a furt С — 
which could result in the development o a sno 
wide norms in physical, mental, social an 


cational development. 
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PRESSURE ON POINT AND BARREL 
OF A WRITING INSTRUMENT’ 
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University of Oregon 


THE PRESENT study is a further extension of 
investigations of pressure phenomena in hand- 
writing conducted by members of a Committee for 
Research in Basic Skills at the University of Wis- 
Consin. Two previous investigations reported by 
Harris and Rarick (1, 2) were limited to the study 
of pressure applied to the point of a writing in- 
Strument. The studies were concerned with the 
methodology of examining point pressure phenom- 
ena and the relationship between po int pressure 


and legibility in handwriting. | 

The previous Wisconsin investiga tors were 
limited to the study of pressure on point because, 
as Harris and Rarick (1) have pointed out, no sat- 
isfactory method of mesuring pressure exer ted 
upon the barrel of a writing instrument had been 
devised. The problem of aded uately measuring 
pressure exerted upon the po int ofa writing in- 
Strument was, however, $0 lved by recording 
Pressure through the use ofa platen and ans 
guages coupled with a vacuum tube erc 
а recording oscilliograph. Itappea re d a 
Comparable technique might be employed in mea- 
E pressure on — the appropriate in 
Strumentation were available. 

Gopaedueritiy, a grip pressure transducer (em 
Was developed by the Parker Pen Company 


the 
experi в. The development of 
Ker pee EAD. ple 1) the study of 


transducer pen made possi 
Pressure applied to the barr el as well "= 
Point of a writing instrument and 2) the exa oa 
tion of possible interrelationships betweenp 
and 

b m f this study was to ex- 
sure phenomena in an 
lationships and pres- 


three questions were 
nship between pres- 


Sought. 1) What is therelatio ] 
= applied to the point and pressure applied to 
article. 


* Footnotes will be found at the end of the 


the barrel of a writing instrument? 2) What in- 
ter-finger barrelpressure patterns can be differ- 
entiated for individuals? 3) Will barrel pressure 
patterns tend to be different for adults and for 
children? Logically, it might be presumed that 
light point pressure would go with light barrel 
pressure; that an individual's indexfinger, middle 
finger, and thumb would exert about equal pres- 
sure on barrel; or that handwriting becomes a 
more personalized act as a child matures, and 
consequently, more variable for a group of adults. 
Empirical answers to the questions were sought, 


Method 


Population and design. —In order to determine 


whether pressure patterns tend to differ as fa- 
miliarity with the handwriting act increas es 
Ss were chosen from three educational levels: 
grade four, grade six, and college. The choice 
of these three levels was based upon the followin 
assumptions. Childreningrade four ar e Ae 
most schools, still in the transitional period be- 
tween manuscript and cursive Writing; they are in 
the early stages of establishing the ir cursive 
writing habits and skills. By grade six the 
children are skilled in cursive writing and apt to 
be writing as wellas, or better than they will 
write at any period. College stude nts have had 
ten years or more experience with cursive writ- 
ing; their writing habits are well established 
Subjects were run in blocks of ten with five 
males and five females ineachblock. Two blocks 
of ten Ss were run from each grade level. The 
college Ss were upper-class undergraduates and 
graduate students enrolled in education cours 
at the University of Wisconsin. They were 1 ей 
sen at random and asked to participate inth 
study. Ss from grades four and six were students in 
the laboratory school. They were chosen at Tane 
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dom. Data from four sixth-grade Ss had to be 


discarded due to malfunction of the apparatus. 


Consequently, 20 college students, 20 fourth 
graders, and 16 sixth graders participated in the 
study. 

Instrumentation. —Three basic instruments 
were employed in the study: a specially con- 
structed table equipped with a pressure sensing 
platen, an 8-channel GME polygraph, and the grip 
pressure transducer pen. The S was unable to 
watch the recording of pressure since the poly- 
graph was turned away from him, yet E was able 
to observe S’s performance and make adjustments 
when necessary. 

The table and pressure Sensing platen were 
used in the previous Wisconsin studies and have 
been described by Harris and Rarick (1). Briet- 
ly, it is a standard height table with a pressure 
Sensing platen mounted flush with the surface in 
a rotating disk, which permits placement of the 
platen at a comfortable writing angle for each S. 
The platen rests upon four strain guages which 
measure change in force exerted upon the platen. 

For the present study, the crucial instrument 
was the grip pressure transducer pen. Develop- 
ment of the pen made the study of finger pressure 
upon the barrel of a writing instrument through 
the use of electronic equipment feasible. The 
advantages of measuring pressure phenomena 
through the use of such equip ment over devices 
formerly used were discussed by Harris and 
Rarick (1). The pen, the only one of its kind, 
was developed for the Committee for Research in 
Basic Skills by the Experimental Process Lab of 
the Parker Pen Company, Janesville, Wisconsin. 

The transducer pen, like the platen, employs 
Strain guages to measure pressure. With the 
pen, pressure exerted by each of three fingers— 
thumb, middle, and index— to s egments of the 
barrel of the instrument can be measured. Fig- 
ure lisa photograph of the transducer pen and 
the connector plugs. Physical specifications for 
the pen are given in Table I. 

The tapered plastic Shell is held tightly at the 
rear, on a shoulder of the brass rod structure. 
It fits in contact with the raised ring on the seg- 
ments near the forward end, slightly pre loading 
the segments. It also carries a replaceable ball 
point. The shell is slit, over the segment slits, 
in the tapered section to increase its compliance. 

Electrically, two SR-4#a-18 strain guages are 
mounted on each segment beam. These guages 
are active, in extension, comprising two arms of 
a bridge on each beam. Six add itional similar 
guages are contained in a case mounted on the 
rear end of the structure. These guages com- 
prise the inactive arms of the bridges. There- 
fore, there is a complete bridge, internally con- 
nected, on each segment beam. Four leadsof 


each bridge (two input-two output) are brought out 
to a four-pin plug. 

The vacuum tube amplifier and recording os- 
cillograph used in the earlier Wisconsin studies 
Were replaced in the present study by a Gilson 
Medical Electronics 8-channel polygraph with two 
Strain guage carrier units.! The strain guage 
carrier units were used in recording pressure 
applied to the platen and to the barrel of the 
transducer pen. Sincejust two strain guage car- 
rier units were available, one was used to record 
point pressure at all times while the other re- 
corded thumb, index finger, and middle finger 
pressure for each S. 

Pressure records produced by the polygraph 
were on standard EEG paper. The record of one 
S is shown in Figure 2. In the illustration, pres- 
Sure exerted upon the barrelofthe transducer pen 
by the S’s index finger was simultaneously record 
ed with pressure applied to the platen by the point 
of the pen. The upper ink line shows variation in 
point pressure and the lower line shows variation 
in index finger pressure. Greater point pressure 
causes deviations down from the base, whereas 
greater finger pressure causes deviations up from 
the base. 

The instrument was carefully calibrated for the 
platen and for each finger seg m ent of the trans- 
ducer pen. This was done by placing standard 
100, 200, 300, 400, and 500 gram weights on the 
appropriate pressure pointsand noting the magni- 
tude of the deviation from the base line caused by 
the several weights. This made it possible sub- 
Sequently to convert centimeters of deviation 
from base into grams of pressure applied to the 
various segments. 

Task.— The S was simply asked to write the 
Standard sentence used in the previous Wisconsin 
Studies: “The quick brown fox jumps over the 
lazy dog. ° This was shortened to ‘The brown fox 
jumps’’ for the fourth grade and sixth grade SS- 
Since exploratory studies had shown that the SS 
pressure pattern was stabilized by the second or 
third write-through, each S wrote the standard 
Sentence three times in each sequence, 

It was necessary to have each S write through 
three sequences: one sequence for each of the 
three fingers. As stated above, since only two 
Strain gauge carrier units were ava ilable, point 
pressure plus one finger pressure were recorded 
оп any one sequence. Tochange fingers, E mere- 
ly had to change the connector plugs joining the 
transducer pen and the polygraph and balance the 
polygraph. Thus, it was possible for most Ss to 
complete the task in about ten minutes. 

The sequence followed with eachS can be brief- 
ly described. The S was shown the instruments 
and questions were answered. He was made com- 
fortable in the adjustable chair at the table, and 
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Grip Pressure Transducer Pen. 


FIGURE 1. 


| | 

POINT [PRESSURE | 
| | | | 

| 


qne) (10000) PRESFORE | | | ||| | 
B | 
l | 


ssure Record of a Typical Subject 


FIGURE 2. polygraph Pre 
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the platen was rotated tosuithim as he wrote his 
name. The standard sentence was typedon a card 
and he was told simply to copy it in cursive style 
and to write it whenever E said “OK, write." He 
was cautioned to keep his fingers on the proper 
segments of the transducer pen barrel and E 
checked this as he wrote. Between sequences, 
while E changed connections and balanc ed the 
polygraph, S was told to relax. 

Analysis of the pressure records. — Harris 
and Rarick (2) showed that the word “jumps” in 
the standard sentence has a force variation ratio 
highly correlated with the force variation ratio for 
the entire sentence (about . 9). For this reason, 
the absolute pressure and force variation were 
determined for “jumps’’ in the third write-through 
in each sequence for each S. The procedure for 
determining absolute pressure and force variation 
is described below. 

It was pointed out that the instrument was cal- 
ibrated to permit conversion of deviation from 
base in the pressure record into grams of pres- 
Sure. Figure 2 demonstrates the varia bility of 
point and grip pressure applied by a typical S. It 
was, therefore, necessary to develop a procedure 
for establishing an absolute pressure level. The 
procedure that appeared to work satisfactori ly 
Was a simple one. The greatest deviation from 
base in the criterion word was measured in centi- 
meters; this was also done for the least deviation. 
The two distances were then summed and divided 
by two. When a line Was drawn parallel to the 
base at the resultant average dista nces, in most 
cases that line had equal areasabove and below 
it. This is illustrated in Figure 3. In instances 
where there was disparity in areas above and be- 
low the average line, the line was adjusted up or 
down to correct the disparity. The distance be- 
tween the base and the average line could then be 
converted to absolute, or average, pressure in 
grams for the criterion word. 

The procedure for determining force variation 
is similar, but not identical, to that employed by 
Harris and Rarick (1, 2). In the present study, 
the length of the line of the pressure record (see 
Figure 2) was simply divided by the length of the 
base line of the criterion word to get the force 
variation ratio. This Simplified method appeared 


to result in an adequate estimate of force varia- 
tion, 


Results and Discussion 


It has been stated that the primary purpose of 
the present study was to examine barrel and point 
pressure phenomena in anattempt to deter mine 
what relationships and pressure patterns appear 
to exist. Essentially, then, the study was explor- 
atory. A major focus was upon the methodology 


of examining grip pressure phenomena in hand- 
writing while remaining within the general frame- 
work of the previous Wisconsin studies. The 
methodology section of this paper reports the E’s 
resolution of a number of problems. | 

A second major focus was upon the examina- 
tion of patterns and relationships that would fa- 
Cilitate the identification of pertinent variables 
for further study. Answers to three ques tions 
Were Sought in this connection. 1) What is the 
relationship betwwen pressure a pplied to Tug 
point and pressure applied to the barrel of a pian 
ing instrument? 2) What inte r -finger barr e 
pressure patterns can be differentiated for indi- 
viduals? 3) Will barrel pressure patterns tend to 
be different for adults and for children. These 
questions are examined inthe lightof the present 
data. 

Due to the exploratory focus of this study and 
to the nature of the data, emphasis is placed upon 
the reporting of findings for individual Ss as well 
as upon tendencies exhibited by gro ups. Thone 
is no attempt to demonstrate s ta tistical signifi I 
cance of group tendencies for two reasons: 1) for 
the most part, the size of groups identified was 
Small and, more important, 2) what constitutes 
an actual behavioral difference in grip pressure 
is not known—it would be fruitless to claim sta- 
titistical significance where behavioral signifi- 
cance is not clear. 

Inter-finger pressure patterns.— Table “| 
shows 1) the absolute pressure (in hundreds 
grams) applied by each of three fingers” thum 
(T), index (I) and middle (M)— to the barrel o 
the transducer pen; 2) the absolute pressure ap- 
plied to the point of the pen (the mean of the thr p 
measures obtained); and 3) the force variation 0 
each of the three fingers and the point. ss de 
variation was determined by dividing the length ies 
the polygraph pressure record for the criterio 
word by the length of the corresponding base ps 
Thus, the larger the force variation ratio, p 
greater the variability of the pressure applied by 
the S. 

Subjects are grouped by finger pressure ра 
tern. For example, TI M is a finger pene 
pattern: the greatest absolute pressure is esito 
by the thumb, with the index and middle finger? 
ranking second and third inabsolute pressure арт 
plied. Examination of Table П provides an Est 
Swer to the question: What inter-finger barre 
pressure patterns can be differentiated for ys 
viduals? Six patterns were demonstrated: T I nd 
TMI, ITM, MIT,IM T andM TI. Thi 
includes all possible combinations. Most ofthe 


Ss, however, fell intothree groups: TI M, T MI, 


andI TM. 


In some cases (marked by asterisks in Tabie 
I) the absolute pressure was the same for tw 


Y 


E 


FIGURE 3. 


Jl. 
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TABLE I 


SPECIFICATIONS FOR THE GRIP 
PRESSURE TRANSDUCER PEN 


Shape Round 
Length 5-7/8 in. 
Thickness 7/16 in. 


1/2 in. to 1-1/2 in. from 


Range of Grip 
point. Median at 3/4 in. 


Center of Gravity |2.60 in. from point 


30.5 grams 


Weight 
(Thumb 1109 
Segments (Index 110° 
(Middle 140° 


| | 


| 
EET 


ph Record Showing Analysis of the Criterion Word. 
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TABLE II 


ABSOLUTE PRESSURE AND FORCE VARIATION FOR EACH SUBJECT (GROUPED BY FINGER PRESSURE PATTERN) 


Force Variation 


Pressure 
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Point 


M 


Point 


M 


Sex 


Level 


2.6 
1.8 
1.7 
3,3 
3.0 


1.0 
1.2 
1.0 
1.3 
1.2 


1.2 


1.1 


2.3 
2.0 
1.0 


1.00 
2.50 
1.50 
4.25 
3425 


1.75 
3.00 
2.00 
5.00 
4.25 


2.00 
3.25 
4.00 


Adult 


0 
1.5 
1.0 


153 


1 


1.6 
1.9 
ъз 
1;7 


М 


2.5 
1425 


5.25 
4.25 


z Ë, 


153 
1.4 


2.0 
2.4 


1.0 
1.0 


1.1 


lig 2 
1.2 
1.5 
1.2 
1.3 
1.8 
2.1 


1.7 


1.2 
149 
1:3 
1:5 
2.3 
3.3 


2.5 


3.5 
35:5 


2.0 


5.25 
4.5 


Grade 6 


1.6 
2.2 
2.5 
l.i 


0.75 
2.0 


2.5 
5.5 


M* 


1.1 
1.0 
1.0 
1.4 


2:25 


2,25 
2.0 


345 
5.0 


1.3 
2.7? 


2.25 
8.75 
9.0 


142 
TAS 


0,5 


2.6 


1.25 


3.25 


1.8 
1,6 
1.2 
1:3 


1.3 
Tyl 
1.0 
1.0 
Тыр 


1.1 
1,9 
1.4 
1.2 
1, 
1.0 
LA 


1.4 
1.1 
13 
1.4 


3.3 


3.25 
3.5 
2.0 
2.0 


4.25 
4.0 
mon 


5.0 
5.0 


Grade 4 


1.75 
122 
1.2 
133 
1.9 
155 
1.9 
1«2 
2.1 


3.25 
3.0 


2.25 
3.50 
3.0 


1.3 
1.4 
Lat 
1,3. 
T 


113 
1.5 
Lat 


2.75 
2.75 
2:5 


6.25 
5.0 


145 
1.0 
1.1 


M 


3425 
4.75 


4.25 
5.25 


3.5 
3.0 


1.3 


La 


1,2 
Let 


3.25 
1.0 
3.0 


1.0 
1.2 


2.75 
3.0 


1.2 


1.2 


Ll 


M* 


*Absolute pressure same for two fingers. 


< 
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TABLE II--CONTINUED 


Force Vuriation 


Pressure 


Point 


Point 


Sex 


Level 


pu 1.2 3.3 
1,2 


1.3 


1 


2. 


1.75 

2.75 
1.25 
1279 


9.00 4.00 
3.00 


4.5 


Adult 


2.0 
1.6 


1.0 
1.3 
1.1 


1.0 1.6 


1.3 


1.3 
2.7 


1.3 
1.6 


3.00 
24/25 


7.00 


zu 


L7 


фа} 


1.0 
2.25 


3.75 
8.75 


2.0 


L9 


1.25 


4.50 


+ 


1.0 
1.0 
L.2 


Esk 


1.2 


1.75 
2.4 
1.6 
1.2 


5.5 2.5 


8.75 


Grade 6 
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о 


1.3 


1.2 


2.5 
2.25 
2.5 
3.25 


3.75 


2.15 


8.5 


1.6 
1.6 
2.4 


lm 


1.3 
1.8 


3.75 
3.5 


1.3 


1.3 
142 


3.5 
4.0 


Mk 


1.3 


1.4 


1.75 


7.25 


1.6 
1.6 


1.2 


1.0 


1.3 


1:3 
1.3 


6.50 4.75 3.25 3.0 
ay 
2.75 


M 


Grade 4 


Leal 
1.1 


2.3 
0.7 


1.50 


5.25 


Nt 


1.0 
1.0 
1.2 
Lal 


1.2 
1.0 
2.0 
1.6 


2.6 
3.8 


1.25 
2.0 


3.25 
3.0 
3.0 


5.75 
7.25 
5.25 
5.0 


1.7 


1. £ 
1.2 


2.75 
2,25 


1.6 


1.3 


Point 


Point 


Sex 


Level 


2.5 
1.9 


1 
Sol 


2,1 


5.0 
lol 
Le 


1.3 
1.5 
1.9 
2.0 
1.5 
1.6 
1.2 


2.00 
0.75 
1.50 
2:25 
0.75 
3.50 
1.50 


3.0 


5.25 
4.50 


Adult 


1.0 
1.1 
1,5 
1.0 


1.0 
1.3 


1.1 


2.25 
3.25 


5.25 
5.00 
2.00 
6.25 
3.00 


1.6 
1.6 
1.9 
2.6 


1.6 


1.7 
2.0 


2.50 
1.50 
6.00 
2.00 


1⁄2 
2.0 


1.2 
152: 


2.3 


1.6 


1.3 


1.05 1.1 


1.6 


1.5 1.0 1:25 


4.75 


Grade 6 


*Absolute pressure same for two fingers. 
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TABLE II--CONTINUED 


Force Variation 


Pressure 
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2.5 


Ll 1.0 


1.42 


4.75 1.0 3.7 


5.25 


Grade 6 


*Absolute pressure same for two fingers. 


**S was left handed. 
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ae. These Ss were grouped with the pattern 
most ay approximated. Here, of course, the 
теи ity of the patterngroup placement is ques- 
ee е, Informal study, however, has shown 
verit he larger the inter-finger differences in ab- 
Solute pressure, the greater the reliability. This 
е ү ев the notion that what constitutes a be- 
n al difference in absolutefinger pressures 
eeds to be determined. 
"ES s HI presents the mean pressure and force 
A ation for each finger pressure pattern group 
Y grade level. The range of absolute pressures 


is also indicated. 

. It appears that one conclu 
with Some confidence from Ta 
Eee finger barrel pressure patter 

e demonstrated. There is a marked tendency 
for Ss to fall in the TI M, T MI. and T M pat- 
terns, but all possible patterns were demonstrat- 
ed. In addition, an implication seems clear. E- 
Ven when Ss from a particular pattern only are 


Considered, there is great between-S dis ра rity 
d by each of the 


between barrel pressure exerte ) 
hree fingers. It would appear to be illogical, 
then, to sum pressures across fing ers to obtain 


a mean barrel pressure for a subject. 
bution of Ss to the 


Table IV shows the distri 
Several grip patterns on the basis of grade level 
and sex. With the possible exception of the ITM 
Pattern, males and females appear to be fairly 
cvenly distributed over the variety of grip pat- 
erns. This breakdown by grade level permits 
examination of another of the questions raised: 


ill barrel pressure patterns tend to be different 
| Š 2 Looking at the ITM 


for adults and for children? 
s that there may 


and the T I M patterns, it appear 
р à nce to exist. The 


be some tendency for a differe х 
implication would appear to be that studies should 
not lump Ss from different grade levels together 
Without further investigation. | | 
т Point and finger pressure Fett onships: — 
° able V presents the finger point pressure Tatio, 
Y grade level, for the three dominant grip pres- 
Sure patterns. The finger/point pressure ratio is 
Simply mean finger pressure divided by mean 


Point pres Examination of the 
s Table HI). Exan : 
ure (see o the question: What is 


le suggests wer t 
bs relationship between pressure applied to the 
oe of a writing instrumen ? It can be seen in 
beu V that 2. 1 to 3.8 times the pressure is ss 
fad. by the dominant pressure finger (thum or 
pa as by the point of the W riting АА oe 
SSure exerted by the medium р e 


is 1.9 to i 
А 2.3 ti xerted by pol 
3 times that € to 1.5 times the 


low ts 0 
p ess i 2 - 
т ure finger exer There is little be 


Pressuy, i 
x Ë 
exerted by the poin /point pressure 


een-fin i finger 
танов. ger overlap in the š and low 
; that is inant, medium, 2 

the domi tinctfrom each oth- 


> 


Pres 
Sure fingers are quite dis 


sion can be drawn 


bles II and III: in- 
ns can, indeed, 


er as far as relationship to point pr i 
т. Obviously, коа owes ср 
umb, index, middle—exerting the domi etm 
medium, or low pressure varies from е 
ме aeg pattern to 
Logically, it would seem reas 
who exhibit low grip pressure | = 
point pressure and that Ss who exhibit hi h | 
pressure might exhibit high point pre = an 
Whether this would be demonstrated psych de e 
ally, however. was not known. Also Ss ‹ ipe 
categorized according to high or low grip earn E 
and point pressure, the effect of various emis 
nations of high and low grip and point вава xA 
could profitably be examined by further st Жү! 
ee an attempt was made to ns 
S accor i i 
Spas ing to high or low grip and point pres- 
Two factors complicated this attempt to cat 
gorize Ss. 1) Since the pressure exerted b ees 
of three fingers is quite different for a ded em 
5, еасһ ої the three fingers must be с dus com 
in examining grip pressure. 2) A E EI 
be selected to determine what constitutes hi (pes 
what constitutes low grip and point pres е 
These factors were considered in the ‘ate ° Se E 
tions shown in Table VI; a rationale for Ges 
gorizations follows. ne 
The mean point and fi ү ^ 
particular grade татр сеа Drop ese ; at eie 
(see Table III) were taken as the ei dn l. is 
Thus, whena S's finger or point un 
above the group mean, this was taken to de eds 
high pressure; finger or point pressure bel 2 
group mean was taken to denote low pr s s. sy 
Table VI shows how each S was rated for fp h 3 
or low (-) pressure applied by viciis р ү 
ger and by the point of the pen. Thus if ft 
rated a plus for each finger and a plus i = a i 
he was categorized as H (high gr ip eres poinh 
high point pressure). Likewise, ifa S Ta i er 
minus for each finger and a minus for : К : 
was categorized as L (low grip pressu: ees fs 
point pressure). шин. 
Some Ss were categoriz i 
asterisk); in these Es ne an an ы ss 
categorization was marred by the Revit Ead 
finger from an otherwise consistent ein ‚е 
el. A few Ss were categorized X. In thes Е 
there was not а consistent pointand grip : sees 
level; rather, there was consistently high Md inm 
finger pressure opposed to low ( or high) 5 (n 
pressure. Only Ss exhibiting the three поо 
mon finger pressure patterns (T MI Tix. P 
M) were categorized; the I T M Ss in r dun e 
and six were dropped because of xi E E 
grade six and the left-handers in grad dur is 
Table VII presents a summary of the nates i 
zations shown in Table VI. Of a fatal о (ee 
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TABLE IV 


GRADE L.VEL AND SEX OF SUBJECTS BY GRIP PATTERN 


= 

TMI TIM 
M E > M F > 
1 4 5 2 3 5 
3 2 5 4 3 7 
а 2 6 4 6 10 
8 8 0 2 


= 
o 
= 
lea 


EMT 
> M F > 
0 1 1 2 
1 0 0 0 
0 0 0 0 
йт @ 1 2 
(1) Both Ss were left handed. 
TABLE V 
GRIP/POINT PRESSURE RATIO FOR EACH GRADE LEVEL BY PATTERN 
—— 
M 
M/Pt 
1.1 
0.8 
li 
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considered, 35 were classifiedas H, L, or X. 
The remaining ten did not clearly fit into any of 
the categories as they are defined here. There 
does not appear to be any striking overall sex 
difference. On the other hand, grade four fe- 
males appear to have a disproportionate number 
of Ss in the L classification, and grade six fe- 
males for some reason appear not to have been 
classifiable at all. Two conclusions seem rea- 
sonable: 1) a substantial number of Ss can clear- 
ly be classified by the procedure outlined; and 2) 
in general, high point pressure goes with high 
grip pressure and low point pressure goes with 
low grip pressure—but there are exceptions. 

Force variation. —Harrisand Rarick (1) found 

that force variation was more closely related to 
legibility and speed in handwriting than was ab- 
solute point pressure. Inthe presentstudy, force 
variation was examined inrelationto finger pres- 
sure pattern, grade level, andabsolute pressure. 
Only in the latter case did the re appear to be an 
orderly relationship. Table VIII demonstrates 
this relationship between force variation and fin- 
ger pressure. The inter-finger rankings by ab- 
Solute pressure and by force variation for pres- 
Sure patterns within grade levels are identical. 

It is true, of course, thatthe higher the abso- 
lute pressure, the greater is the possibility for 
variation (magnitude of deviation from base, or 
Zero, pressure). On this basis, the demonstrat- 
ed results— the greater the absolute finger pres- 
Sure, the greater the force variation for that fin- 
ger— might be anticipated. Yet, it is reasonable 
to point out that the finger exerting the dominant 
pressure may be the *steering"finger in the 
handwriting act, and, consequently, exhibit the 
greatest force variation due to push - pull move- 
ments. Identification of a ‘steering’ finger 
within each finger pressure pattern could prove 
to be the critical factor in any future demonstra- 
tion of relationships between finger pressure pat- 
tern and, say, legibility in handwriting. 

Conclusions and implications. —The results of 
the present study warrant several conclusions 
which, in turn, have implications for the design 
and execution of further studies of point and grip 
pressure in handwriting. 

1. The fundamental conclus ion to be drawn 
from the study as a whole is that finger pressure 
as wellas point pressure can, indeed, be mea- 
sured through the use of electronic instrumenta- 
tion. The grip transducer pen makes feasible the 
study of barrel pressure applied by the individual 
fingers of a single S without unduly disrupting the 
normal handwriting act. 

2. There is great between-S variability in fin- 
ger pressure patterns ex hibited; all pos si ble 
combinations of thumb, middle, and index finger 
were demonstrated. There is, however, a mark- 


ed tendency for Ss to fall inthe TI M. T M I, and 
I T M patterns. | 

3. When the Ss within the most common fin- 
ger pressure pattern groups are cons idered, 
there appears to be a) a tendency toward a grade 
level differential in thel T M and T M I patterns; 
and b) no sex difference within patterns. The 
pattern differential for different gr ade levels 
should be examined further. The differe ntial 
could be due to differences in early instruction— 
assuming that early patterns persist in adults — 
or to adaptation in grip due to any of a wide vari- 
ety of reasons. Ineither case, findings would 
have implications for instructional practice. 

4. The inter-finger absolute pressures ex- 
hibited by individual Ss are widely varied. The 
clear implication is that the absolute pressures 
for the three fingers cannot logically be summed 
to determine an absolute barrel pressu re; nor 
would any one finger provide an adequate indica- 
tion of barrel pressure exerted by a S. 

5. There is a distinct fing er/point pressure 
ratio for each finger when dominant, medium, 
and low pressure fingers are considered in the 
ratios for the three common finger pressure pat- 
tern groups. However, when the actual fingers— 
thumb, middle, or index finger rather than the 
dominant, medium, or low pressure finger— are 
considered in the ratios, there is almost absolute 
overlap in the range of finger/point pressure ra^ 
tios. It appears, then,to be of little value to ex- 
amine finger-point pressure relationships without 
first having determined finger pressure patterns 
of the Ss being studied. | 

6. Even when all three fingers are taken into 
account, a majority of Ss can be classified ас- 
cording to high or low grip and point pressure. In 
general, high point pressure is ac c ompanied by 
high grip pressure and low point pressure is aC- 
companied by low grip pressure; but Ss can be 17 
dentified who exhibit low point and high grip pres- 
Sure or high point and low grip pressure. Identi- 
fication and study of Ss in the various categorie? 
could yield interesting and valuable results; for 
example, point and grip pressure could be SY97 
tematically varied in studies of motor control, 
legibility of handwriting, speed of writing, etc. | 

7. The greater the pressure applied to barre 
by a particular finger, the greater the var iation 
in pressure (force variation) applied by that finge 
is likely to be. This findinglends some supp OF 
to the notion that the dominant pressure finger 
may also be the “steering” finger in the hand- 
writing act. Yet, the direct relationship is dem- 
onstrated only with group means; there are many 
exceptions exhibited when pressures of individual 
Ss are examined. The true relationship betw een 
dominant pressure and “steer ing’’ finger migh 
be gotten at by direct observation of the idiosyn- 
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cracies of individual grip patterns while the S is 
actually writing. 

The overall conclusion appears to be that while 
handwriting is a highly personalized act, certain 
group tendencies can be identified in pressure 
phenomena. Future research ought to be con- 
cerned both with the idiosyncracies and the com- 
monalities. 


Summary 


The present study wasan extension of previous 
research in pressure phenomena in handwriting 
reported by Harris and Rarick. Whilethe earlier 
Studies were concerned primarily with point pres- 
Sure, development of a griptransducer pen by the 
Parker Pen Company made feasible the measure- 
ment of grip pressure applied to the barrel ofa 
writing instrument by electronic means. 

The study was concerned with 1) the methodol- 
ogy of examining grip pressure phe nomena, and 
2) the examination of patterns and relationships 
that would facilitate the identification of pertinent 
questions for further study. The study, then, was 
primarily exploratory in orientation. 

Absolute finger and point pressure and force 
variation were reported for the individual Ss 
Studied and a number of group tendencies were i- 


dentified. Implications for further s tudy were 
pointed out. 


FOOTNOTES 


* Funds for the support of this study were pro- 
vided in part by a grantfrom the Parker Pen 
Company, Janesville, Wisconsin, to the U- 
niversity of Wisconsin, and in part by a 
grant from the U. S. Office of Education. 

** The study was conducted while Wayne Otto was 
a research assistant to the Commit tee for 
Research in Basic Skills— Virgil E. Herrick, 
Chairman; Theodore L. Harris, and G. 
Lawrence Rarick—the University of Wiscon- 
sin, Madison. 

1. A technical description may be obtained from 
the Committee for Research in Basic Skills. 
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A STUDY OF RELATIONSHIPS BETWEEN 


CHILD REARING ATTITUDES AND 
MATERNAL BEHAVIOR 


MICHAEL ZUNICH 
Texas Woman’s University, Denton, Texas 


INASMUCH AS the literature is replete with 
studies concerned with the measurement of paren- 
tal attitudes, there is little evidence concerning 
how these attitudes, as measured in the reported 
investigations, are related to the behavior of par- 
ents in interaction with their children. It is сот- 
monly assumed in these studies that measure- 
ments of parental attitudes yield important in- 
Sights into existing parent-child relationships. 
The validity of such a concept, however, has not 
been established by empirical investigations. As 
Bell (1) points out, no studies directly concerned 
With the relation between parental attitudes and 
observed behavior of parents in interaction with 
their children have been reported in the literature. 
Such a study may aid psychologists and educators 
in reducing the complexity of pr oblems involved 
in linking parents’ attitudes to their actual behav- 
lor with their children, and may provide informa- 
tion on characteristics of parents which appear to 
affect the behavior of children. . 

The purpose of this investigation was to test i 
hypotheses that 1) maternalattitudes toward chi 
rearing are significantly related to selected 

aviors of mothers, observed in interaction wi h 
heir children; 2) maternal behavior 1S indep ең 
dent of social class; 3) maternal behavior is x 
dependent of the sex of the child with Whom Hie 


mother interacts. 


Methoa 


The subjects were 80 mothers hasa 
One of their children. Forty of the m» т 40 as 
Classified as lower-class and the dies dm (3) 
middle-class, according to the McGuire-Whi 


nde. à orm). ! 
x of Social Status (Short зя following criteria, 


The 80 mothers meeting i ren, served as 
Subj eet а ite, 2) Amer- 
bjects for the investigation: 1) - full-time 


ican a 
Бога, з) 20-40 уган еб ae ehildren, n 
b Я half of the 
families. Approximately, ik a male child 


ers selected were observe 


and one half with a female child. The children 
ranged in age from two years and nine months to 
five years and one month. 

Although more interaction occurs between 
mother and child in the home than in the labora- 
tory, observations of mothers with their children, 
in this study, have been made in the laboratory 
setting in order to provide a contr ol of the dis- 
tracting stimuli present in homes. Itwas believ- 
ed also that the presence of the observer in the 
home, where it would be difficult for him to re- 
main unobtrusive, would influence the child's be- 
havior to an even greater extent than would an un- 
familiar setting (the laboratory) with his mother 
present. 

The observations of middle-class mothers 
were conducted in the Child Development Labora- 
tory at Texas Woman’s University while the low- 
er-class mothers were observed in the Child Study 
Laboratory at the Florida State University. Both 
laboratories had facilities for observing each 
mother together with her child through a one-way 
vision mirror and contained 1) various types of 
toys, 2) easel with paint, 3) books, 4) blocks, 5) 
small tables with chairs, and 6) a small kitchen 
unit consisting of sink, cupboard and stove. 

Each mother-child pair was broughttothe lab- 
oratory for one 30-minute period for the child to 
play while his mother stayed inthe room with him, 
During this visit, the mother's interaction with 
her child was observed and recorded according to 
categories similar to those developed by Merrill 
(4), Bishop (2), and Schalock (6). 

The symbols, categories, and definitions were: 

(-) Being Uncooperative- -e. g. , Mother ignores 
the child's stimulation. Example: Mother contin- 
ues to read magazine when child addresses her. 

(c) Contacting--e. g. , Mother is in contact with 
the child either verbally or physically. “Physic- 
ally" means sitting or being near the child as he 
plays, even though she says nothing. ‘Verbally’? 
means purely social conversation with the child 
Example: “This is а nice doll-house. We'llsee if 
daddy can build one for you like it. ’’ 
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(n) Criticizing--e.g., Mother criticizes, 
blames, or punishes the child. Example: ‘‘Now 
pay attention to what you are doing. You're pour- 
ing water all over the table." 

(d) Directing--e.g.. Mother specifically states 
the course of action which she wants the child to 
follow. Example: ‘‘Putthe dollover there on the 
table." ‘I want you to close the door now, John- 
ny, not later. ’’ 

(k) Giving Permission--e. g. , Mother consents 
to child's proposed activity. Example: “Yes, 
you may use the towel.’ 

(m) Giving Praise or Affection--e. g., Mother 
praises or gives encouragement tothe child. This 
category also includes expressions of affection 
Such as petting or hugging the child. Example: 
“That's a very fine boat you've made. '* 

(h) Helping--e.g., Mother gives physical 
help to the child. Example: Mother pounds a nail 
for the child or replaces the mastandthe sail be- 
longing to the sailboat. 

(i) Interfering--e.g., Mother interferes with 
an activity on the child's part with the intent of 
Stopping it completely. 
my boy--no more of that splashing. '' “No, John- 
ny, you are not to drink the water from those 
cups." 

(si) Interfering by Structurizing--e.g., Mother 
indicates the undesirability ofa certain action 
and/or the consequences of the act if carried out. 
Example: “You know other boys and girls will 
want to play with those toys and if you mash them 
together like that they will be Spoiled. '' 

(4) Lending Cooperation--e.g., Mother re- 
sponds to child's comments, suggestions, or re- 
quests with apparent interest and willi ngness. 
Example: “I would love to play house with you." 

(a) Observing Attentively--e.g., Mother no- 
ticeably directs her attention to the child and/or 
child's activity by silently watching. Example: 


Mother watches child as the child plays with the 
stove. 


(p) Playing Interactively--e.g., Mother is 
playing with the child withinthe framework of the 
child's own conception of play;she plays as though 
She were another child. Example: “I'll be the 
boat repair man and I'll fix the boat. '° 

(z) Reassuring--e. g., Comfort or encourage- 
ment is offered by the mother. Example: “Don't 
feel too bad. Most children find it difficult to 
work that puzzle the first time. ”’ 

(o) Remaining Out of Contact--e. g. , Mother is 
sitting apart from the child, andis either reading 
magazines or looking away from the child. Ex- 
ample: Looking out of the window. 

(r) Restricting--e. g. , Mother modifies child's 
behavior by reducing intensity, speed, manner of 
executing, etc. , but does not stop activity com- 
pletely. Example: “Don't splash the water so 


high. `° 

(s) Structurizing--e. g. , Mother facilitates ac- 
tivity on the part of the child by methods which 
stimulate independent thinking and relegates the 
responsibility of decision to the child. Example: 
“Do you see something in this room out of which 
you could make a boat?" | 

(t) Teaching--e.g., Mother gives information 
to the child for the purpose of increasing his 
knowledge. Example: ‘‘This is a duck and that is 
aswan. Swans have longer, thinner necks than 
do ducks. '' 


Reliability 


Before observations were made for the purpose 
of data collection, it was necessary to achieve 
relatively high observer agreement with respect 
to the identification of the behavior under inves- 
tigation, and their accurate placement within a 
given time interval. 

Reliability was measured by calculating per- 
centages of agreementbetween two observers re- 
cording maternal behavior simultaneously during 
thirty-minute periods. Middle- and lower-class 
mothers together with one of their children, who 
were not included in the study, served as subjects 
for establishing reliability. The observers be- 
came familiar with the definition of behavior cat- 
egories, scoring system, and code letters. Cat- 
egories were memorized and agreement reached 
concerning types of behavior defined by each of 
the categories. 

Measures of agreement were obtained by com- 
paring the observations of one observer with ob- 
servations taken independently and simultaneous” 
ly by another observer. These measurements of 
agreement may be obtained by (a) computing the 
percentages of agreement of the observers, OF 
(b) correlating total scores obta ined by two ob- 
servers in successive periods of observatio n. 
The correlation method yields a spuriously high 
measure of reliability in that it measures only tO 
tal agreement and not agreement on identical be- 
havior categories within specific time intervals. 
For this reason, the percentage method has bee? 
utilized in this study. 

In utilizing a predeterminedsystem of cate- 
gories, it is difficult to determine whether disa” 
greement between simultaneous records i$ а 
function of placing the recorded observations in 
the appropriate time interval, ora function of dif- 
ference in hearing and seeing in identifying the 
behavior. It is possible for two observers to see 
different interaction occurring at the same time: 
or to miss an event. This may be due to the por 
sition of the observers from which the interaction? 
is viewed, or in recording the behavior (looking 
from the behavior to the stop watch, to the obser 
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vational sheet). Also disagreement may arise 
from differing interpretations of occurring inter- 
action. 

Factors such as the lack of satisfactory beha- 
vior definitions, misinterpretation of occurring 
behavior, and various recording methods of the 
observers are all factors which tend to create 
timing errors in the observation. 

When timing errors areoperating, the compu- 
tation of observer agreement becomes difficult. 
It is impossible to determine errors or disagree- 
ments by inspection alone. Ifbothobservers have 
recorded the same behavior in adjacent time in- 
tervals, there is no assurance thatthe apparently 
disagreeing observations do notactually represent 
the same behavior. However, if both observers 
have the same entries in the same time interval, 
One cannot be certain that the agreement is not a 
Spurious result of time differences, e.g., one 
can never be certain that agreeing observations 
do not actually represent different events. The 
only way by which the observation can be checked 
is by sound photography. Since the physical set- 
tings in which observational studies are ordinar- 
ily undertaken preclude the use of necessary e- 
quipment for sound photography and because the 
expense makes such a technique impractical, 
ratings of mother-childinte rac tion were made 
According to predetermined categories following 
a training period during which two observers 
demonstrated their ability to observe and record 
reliably. When the observers achieveda compe- 
tency in the recording of the behavior represent- 
ed by agreement of . 80 or higher between inde- 
Pendent observations during at least five sessions, 
he collection of data for the project began. 

It was recognized that while the child was un- 
aware that he was being watched, the mother 
Might feel keenly the presence of the observer 
and might modify her behavior in such a manner 
as to present a more favorable picture of the "m 
teraction between herself and child than actually 
exists in the home situation. Procedures for 
Measuring the effect of the observers le que 

n the mother's behavior are being studied by 
er investigators, but no С onclusive evi 


Concerni Spa is currently available. 
s ER iu gine the time spent 


in the laboratory as a half-hour in her own home, 


uring which she is unoccupie 
Playin free to be in the room W 
Ing. She was asked to act as 5 чс 
ae really in this situation. Questions Were 
ered by Stating that there was NC 


der the appro- 
a н The observe 
be ° Category every five seconds. the mother's 
Or constituted the measure of the 


behavior in interaction with her child. 


The Attitude Instrument 


In order to obtain measures of maternal atti- 
tudes, mothers were giventhe PARI developed by 
Schaefer and Bell (5). This measuring instrument 
was selected because itoffers a variety of content, 
assesses a wide range of attitudes, andis one up- 
on which information concerning reliability and 
validity is available. 

During the visit to the laboratory, the PARI 
was administered to the mother by the investiga- 
tor after the observation session, while the child, 
absorbed in his play, was supervised by a gradu- 
ate assistant. The administration was by means 
of a structured interview ina room apart from the 
playroom. 

The items utilized in the PARI were those ap- 
pearing in 16 of the 23subscales. Itwas felt, be- 
cause the PARI measures attitudes toward child 
rearing and family life, that only subscales per- 
taining to child rearing would be used in this study. 
The remaining seven subscales were concerned 
with attitudes toward family life. 


Results 


Since the observations were made in two dif- 
ferent laboratories, reliability was estabiished for 
each laboratory prior to the collection of data. 
Disagreement most commonly evidenced by the 
observers was due to the placement of observed 
behavior in separate time intervals. This error 
was difficult to correct and most troublesome in 
establishing a satisfactory level of reliability. 

The category reliabilities between the two ob- 
servers expressed in terms of percent of their a- 
greement concerning maternal behavior, based on 
ten 30- minute periods of observation, are pre- 
sented in Table I. The percentages of agreement 
ranged from 81 to 100 percent. 

Table II shows the frequency with which mater- 
nal behaviors in the laboratory appeared in each 
category. The categories of Contacting, Direct- 
ing, Observing Attentively, Remaining Out of Con- 
tact, Structurizing, and Teaching constituted the 
major types of the mothers' behavior toward their 
their children, while under observation. Although 
some mothers exhibited such behaviors as Being 
Uncooperative, Criticizing, and Helping, these 
behaviors generally had a low frequency of ap- 
pearance. : 

Nine of the 17 behavior categories showed a 
significant relationship withsocialclass at the .05 
level or beyond when the median test was employ- 
ed. Middle-class mothers evidenced more Con- 
tacting, Directing, Helping, Interfering by Struc- 
turizing, Observing Attentively, and Playing In- 
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TABLE I 


RELIABILITIES OF MATERNAL BEHAVIOR CATEGORIES BASED 
ON TEN 30-MINUTE OBSERVATIONS 


Category Frequency Percentage of Agreement 
Between Observers 


Being Uncooperative 2 86 
Contacting 1418 91 
Criticizing 2 84 
Directing 38 90 
Giving Permission 12 100 
Giving Praise or Affection 12 81 
Helping 5 100 
Interfering 10 96 
Interfering by Structurizing 18 93 
Lending Cooperation 17 94 
Observing Attentively 1126 95 
Playing Interactively 29 85 
Reassuring 4 100 
Remaining Out of Contact 824 93 
Restricting 8 92 
Structurizing 34 90 
Teaching 41 
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TABLE II 


FREQUENCY OF APPEARANCE IN THE LABORAT! 
OR 
OF CATEGORIZED MATERNAL BEHAVIOR S 


Social Class 


Behavior Category 
Middle (No. of) Lower (No. ol) 
(N = 40) (N = 40) 
Being Uncooperative 6 2 
Contacting 6420 2395** 
Criticizing 10 т 
Directing 920 141%% 
Giving Permission 30 2 
Giving Praise or Affection 42 Ee 
Helping 84 34* 
Interfering 36 8 
Interfering by Structurizing 92 11* 
Lending Cooperation 170 35* 
Observing Attentively 4688 2834* 
Playing Interactively 202 qe 
Reassuring 4l == 
Remaining Out of Contact 1285 8616 
Restricting 31 51 
Structurizing 133 134 
Teaching 210 127* 
jue significant at the ште 


¥ Median Test va ignifi 
** Median Test value signifi 


cant at the 
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teractively than did lower-class mothers. How- 
ever, lower-class mothers Remained Out of Con- 
tact more with their children than middle -class 
mothers. In general, the middle-class mothers 
interacted more with their children than did the 
lower-class mothers. 

Behavior categorized as Being Uncooperative, 
Criticizing, Giving Permission, Interfering, In- 
terfering by Structurizing, and P laying Inter- 
actively seldom appeared in the observation of 
lower-class mothers. Giving Praise or Affection 
and Reassuring were entirely lacking inthe ob- 
Served behavior of these mothers. 

The significant relationships which appeared 
between the subjects’ attitudes, as measured by 
the PARI, and their observed behavior toward 
their children are presented in Tables III and IV. 

Of the 544 comparisons made by means of 
Spearman rank correlation coefficients computed 
between frequencies in the 17 maternal behavior 
categories and the 16 attitude Subscales, 16 evi- 
denced significant relationships at the .05 level 
or beyond. Relationships are Suggested by the 
Significant values of the correlation coefficients 
between attitude subscales and behavior categor- 
ies: 

Attitude Subscales Behavior Categories 
Approval of Activity Contacting, Observ- 
ing Attentively 


Avoidance of Communi- Restricting, Remain- 
cation ing Out of Contact 
Breaking the Will Directing, Restrict- 
ing 


Comradeship and Sharing Helping, Teaching 


Encouraging Verbaliza- Contacting, Helping, 
tion Lending Cooperation 
Equalitarianism Contacting, Helping, 
Teaching 


Inasmuch as one might expect, by chance, to 
observe values which attained Significance at the 
. 05 level approximately five times out of 100 when 
no real relationship exists, it would appear that 
interpretation of these statistical relationships 
Should be undertaken with caution. 

Middle-class mothers evidenced 12 relation- 
Ships between the attitude subscales and behavior 
categories while lower-class mothers only four. 
It is possible that lower-class mothers were shy 
and would not interact more freely with their 
children as compared with middle-class mothers. 
However, it is not unlikely that in the home set- 
ting the middle- and lower-class mothers might 


have evidenced more Being Uncooperative, Crit- 
icizing, Interfering, and Restricting behavior, 
for example, than she did in the laboratory set- 
ting because of her desire to appear as a “воой 
mother'' while being observed by ће experimen- 
ter. Itis recognized, however, that the lack of 
apparent relationships may, in many instances, 
be a function of the setting in which the observa- 
tions were made. 

The frequencies of the various types of mater- 
nal contacts with sons and daughters are present- 
ed in Tables V and VI. Of the 17 behavior cate- 
gories, only five showed a significant relation- 
Ship with the sex of the child at the . 05 level, 
when the median test was employed. 

Two behavior categories showed a significant 
relationship with the sex of the child between the 
middle-class mothers and their children. The 
mothers of daughters evidenced more Contacting 
than did mothers of sons. However, mothers of 
sons showed more Observing Attentively behavior 
than did mothers with daughters, | 

Three behavior categories evidenced a signif- 
icant relationship between lower -class mothers 
and their children. The mothers of sons showed 
more Restricting behavior than did mothers with 
daughters. However, the mothers of daughters 
evidenced more Contacting andStructurizing than 
did mothers of sons. 


Discussion 


The lack of statistically significant rela ti o n 
Ships observed between maternalattitudes toward 
children and most of the selected be havior of 
mothers in an unstructured laboratory setting 
Suggests several hypotheses, e.g., the mothers 
behavior evidenced in a laboratory setting may 
not have been representative of their behavior un- 
der home conditions. Since the mother knew that 
an observer was present, she may have evidenc- 
ed more socially acceptable behaviors than is uS~ 
ual in the home situation. 

If the experimenter obtaineda reasonably close 
approximation of customary mother-child rela- 
tionships, however, the findings suggest that ma- 
ternal behavior cannot be predicted from an an^ 
alysis of maternal attitudes toward children. 
the mothers displayed a more socially acceptable 
type of interaction with the child inthe laboratory 
than is habitual in the home, it could not be as- 
сегіаіпеа whether such behavior played a predom- 
inant role in their relationship or whether it was 
merely conditioned by the presence of the obser 
ver. 

Since the middle-class mothers interac ted 
more with their children, the lower-class moth 
ers may have exhibited shyness or reticence in ? 
totally unfamiliar situation. This is suggested PY 
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TABLE III 


CORRELATION VALUES BETWEEN MATERNAL ATTITUDE SCORES AND 
OBSERVED BEHAVIOR RATINGS OF MIDDLE-CLASS MOTHERS 


i : Behavior Categories 
Contacting Directing Helping Observing Remaining Teaching 
Attentively Out of Contact 


Attitude Subscales 


Approval of Activity .34* .46* 

Avoidance o Communication ‚ 46** 

Breaking the Will .35* 

Comradeship and Sharing .32* .36* 

Encouraging Verbalization .34* .36* .37* 
.32% .36* .34* 


Equalitarianism 


* Significant at . 05 level. ** Significant at the . 01 level. 


TABLE IV 


N MATERNAL ATTITUDE SCORES AND 


VALUES BETWEE 
GORRA р BEHAVIOR RATINGS OF LOWER-CLASS MOTHERS 


OBSERVE 
Behavior Categories 
g Lending Cooperation Restricting 


i bscales 
Attitude Su seus 
Avoidance of Communication „84* eC 
j ‚ 46** 
Breaking the Will . 34 6 
izati .36* 
Encouraging Verbalization 


—— 


жж Significant at . 01 level. 
* Significant at . 05 level Signi 
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TABLE V 


FREQUENCY OF MATERNAL CONTACTS OF MIDDLE-CLASS 
MOTHERS WITH SONS AND DAUGHTERS 


Behavior Categories 


Mothers’ Interaction with 


Being Uncooperative 
Contacting 

Criticizing 

Directing 

Giving Permission 

Giving Praise or Affection 
Helping 

Interfering 

Interfering by Structurizing 
Lending Cooperation 
Observing Attentively 
Playing Interactively 
Reassuring 

Remaining Out of Contact 
Restricting 

Structurizing 


Teaching 


Sons Daughters 
4 2 
2962 3458* 
7 3 
419 501 
17 13 
23 19 
37 47 
21 15 
39 53 
81 89 
2989 1699* 
103 99 
27 14 
605 683 
19 12 
61 72 
93 117 


* Median Test value significant at the . 05 level. 
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TABLE VI 


FREQUENCY OF M^ TERNAL CONTACTS OF LOWER-CLASS 
MOTHERS WITH SONS AND DAUGHTERS 


Behavior Categories Mothers’ Interaction with 


Sons Daughters 
Being Uncooperative 1 1 
Contacting 949 1446* 
Criticizing 2 1 
Directing 60 81 
Giving Permission es 2 
Giving Praise or Affection --- ee 
Helping 15 19 
Interfering 4 4 
Interfering by Structurizing 6 5 
Lending Cooperation 18 17 
Observing Attentively 1500 1334 
Playing Interactively 3 4 
Reassuring “<= nem 
Remaining Out of Contact 4528 4088 
Restricting 29 22*' 
Structurizing 50 84* 
Teaching 57 70 

e . 05 level. 


* Median Test value significant at th 
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the low frequency of both positive and negative 
behaviors, e.g., Being Uncooperative, Criticiz- 
ing, Directing. Giving Praise or Affection, Help- 
ing, Interfering, Interfering by Structurizing, 
Lending Cooperation, Playing Interactively, Re- 
assuring, Restricting, Structurizing, and Teach- 
ing. Schalock (6) states that a mother and child 
spend a large proportion of the time in Non-At- 
tendance and that the interaction which occurs 
most frequently on the part of the mother is At- 
tendant Observation, Statement of Condition or 
Action, Seeking Impersonal Information, Offer- 
ing Verbal Information, Directing, and Joint Par- 
ticipation in Activity. In the present study, these 
behaviors make up approximately 80 percent of 
the lower-class mother’s interaction and 90 per- 
cent of the middle-class mother’s interaction. 

It would be logical to assume that middle-class 
mothers who had children enrolled innurser y 
school would have a tendency to evidence less 
shyness or reticence andwould interact more 
freely with their children than would mothers 
whose children did not attend nursery School, 
Since mothers of nursery school children are ex- 
posed to a parent education program aimed toward 
increasing understanding of children and improv- 
ing parent-child communication. 

The data in the present study suggest several 
hypotheses worthy of further investigation: 

In guiding their children, lower-class mothers 
less frequently than middle-class mothers: 

(a) impose techniques of suggesting, teaching, 
and helping in their interaction with their 
children. 

(b) interact with their children. 

In guiding their children, lower-class mot ers 

more frequently than middle-class mothers: 

(a) evidence more Structurizing behavior with 
girls than with boys. 

(b) are more restrictive with boys than with 
girls. 

Both middle-class and lower-class mothers 

more often approve than disapprove: 

(a) comradship sharing between parentsand 
their children. 

(b) loyalty to parents. 

(c) encouraging children to verbal ize about 
their feelings without fear of reprimand. 

(d) equalitarianism betweenparents and child- 
ren. 

Although it is apparent that there are limita- 
tions inherent in the type of observational metho- 
dology as described in the study reported, e. Bs 
length of time required to trainobserve rS, the 
effect of the observer onthe interaction of the 
subjects. such a method has several advantages 
when compared to others which are frequently u- 
tilized in studies of family interaction. Studies 
which have employed such techniques as rating 


Scales, questionnaires, andinterviews ha ve 
placed. in the investigator's opinion, undue reli- 
ance upon the respondents' evaluation of the kind 
of interaction occurring within the family and 
have failed to obtain the kind of precise informa- 
tion which direct observation yields. Thus, the 
literature is replete with studies of relationships 
which are based upon subjective judgments of aD 
dividuals who, it is generally recognized, not in- 
frequently yield a less self-incriminating mea- 
sure than would have been obtained by a trained, 
objective observer. 

The advantage of recording behavior at the 
moment of occurrence in terms of yielding pre- 
cise statements is obvious, yet relatively few 
Studies have been undertaken us ing members of 
the same family in which their behavior has been 
rated according to predetermined categories and 
rated at the time of occurrence. Admitte dly, 
Such a technique is expensive interms of the time 
required for the data collection. However, until 
such studies are undertaken in order to determine 
the behaviors employed by family members 1n 
their interaction with others, many ofthe conclu- 
Sions of investigators of family behavior who have 
made use of the traditional questionnaire, ratin£ 
Scale, and interview, must be considered tenta- 
tive. 


Summary 


This investigation Sought to test the hypothesis 
that 1) maternal attitudes toward children are Sig 
nificantly related to selected behaviors of moth- 
ers, observed in interaction with their children; 
2) maternal behavior is independent of socia Р 
class; and 3) maternal behavior is independent 0 
the sex of the child with whom the mother inter- 
acts. 

The categories of Contacting, Directing, OP- 
serving Attentively, Remaining Out of Contac T 
Structurizing, and Teaching constituted the Esp 
types of the mothers’ behavior toward their chil E 
ren, while under observation.  Middle-cla9$ 
mothers evidenced more Contacting, Direc wu 
Helping, Interfering by Structurizing, Observ ed 
Attentively, and PlayingInteractively ma i 
lower-class mothers. Lower-class mothers М 
mained Out of Contact more with their childr € 
than did middle-class mothers. In general, ч 
middle-class mothers interacted more with the 
children than did lower-class mothers. ae 

Of the 544 comparisons made by m Cane 
Spearman rank correlation coefficients computer 
between frequencies in the 17 maternal behav 
categories and the 16 attitude subscales, 16 ev 
denced significant relationships at the . 05 nh 
or beyond. Middle-class mothers evident 105 
twelve relationships between the attitude subsca 
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and behavior categories while lower-class moth- 
ers only four. 

Of the 17 behavior categories, only five showed 
a Significant relationship with the sex of the child 
at the . 05 level when the median test was applied 
between frequencies of maternal contacts with 


Sons and daughters. 5 
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San Jose, California 


THE PURPOSE of the present paper is to de- 
scribe the development of a rating scale designed 
to assess the young child’s adjustment in first 
grade. Although several elementary sc hool be- 
havior rating scales are available (1,2), none 
applies specifically to the child’s adjustment to 
the demands ofthe educational regime in the first 
grade. 

The development of the present scale was dic- 
tated by the requirements of a larger study deal- 
ing with readiness for first grade and first-grade 
adjustment. The investigation was a short-term 
longitudinal one in which a group of five-year-olds 
were studied throughout the year prior to their 
entrance into first grade. The group was followed 
into the first grade where data related to achieve- 
ment and adjustment were collected. Since one 
Of the purposes of the study was to establish re- 
lationships between the skills, abilities, and atti- 
tudes which the child brings to the first-grade 
Situation and the classroom teacher’s evaluation 
of his overall adjustment and achievement in the 
first grade, some criterion measure of adjustment 
upon which the subjects could be rated was neces- 
sary, In addition, such a scale would seem de- 
Sirable in view of the importance and concern 
Which both parents and educators attach to the 
Child's ability to adjust to the initial experience 
Of formal schooling. W hile little information 15 
available in the research literature conc erning 
the relation between early school adj ustment 
and adjustment in later school years, there are 
Indications of at least a moderate degree of con- 
Sistency in individuals’ adjustment over varying 


time periods. 
Procedure 
еее 


Method 


as employed in the 
ty-five first-grade 
hool system 
fac- 


"E. following procedure W 
i Structionofthescale. Twent 
we Hers of a large metropolitan 8€ 

еге interviewed individually concerning the 


Mie чеш ы —— = = = 


* E : 
This research was completed under the spon sorantp 0 


1саро, 


tors related to а child’s adjustment in grade one. 
The years of classroom experience of the teach- 
ers interviewed ranged from three to thirty-nine 
with а median of approximately fifteen years. The 
teachers were asked to mention specific traits, 
abilities, and items of behavior which, in their 
opinions, characterize or describe good adjust- 
ment and poor adjustment in the first grade. The 
data pertaining to good adjustment and poor ad- 
justment were itemized separately. Each item 
was tabulated and its frequency of mention record- 
ed. A preliminary grouping was made in those 
instances in which the trait names or behavior ad- 
jectives were overlapping or relatively synony- 
mous; for example, “reliable” and **dependable'* 
were grouped together. The characteristics list- 
ed for good and poor adjustment were then exam- 
ined for parallel items which seemed to define 
opposite ends of a single continuum. It was inter- 
esting to note that for a majority of the behavior 
items mentioned for good adjustment, comparable 
characteristics were listed to describe poor ad- 
justment. The parallel items for which there was 
at least a minimum level of consensus were placed 
on a five-point scale with “3” representing the 
midpoint, or rating of the “average” child, and 
“1?” and “5” describing poor and good adjustment, 
respectively. Brief descriptive phrases, taken 
largely fro m the teacher interviews, were pro- 
vided for the end points. The items were grouped 
into five major areas: I. Physical Status and Mo- 
tor Behavior, II. Social Behavior, III. Emotional 
Behavior, IV. Intellectual Abilities and Behavior, 
and V. Adjustment to Classroom Membership and 
Requirements. The adjustment scale together 
with the directions for rating appear below. To 
conserve space, only the end points, “1° and **5^, 
are listed. In the scale manual itself each scale 
item is diagrammed on a horizontal line with “1” 
and “5” appearing at opposite ends of the line, 
and the numbers “2”, “3”, and “4” equally 
spaced alongthe line. Separate rating sheets are 
provided, with spaces opposite each trait for the 
appropriate number. 
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FIRST-GRADE ADJUSTMENT SCALE 
Directions for Rating: 


Please read carefully the descriptive phrases 
which appear at either end of each trait scale. 
These phrases define the traits and are to be con- 
sidered as anchor points. It should be noted that 
in every case the left end describes the positive 
or desirable aspect of a trait while the opposite 
is true of the right end. Eachtrait should be 
thought of, then, as existing on a continuum from 
positive to negative. The center of each scale, 
“3”, indicates tne position inwhichthe ‘‘average’’ 
child would be placed with regard to a trait. 

In making your decision concerning the rating 
to be given, freely compare the child with other 
children of his age levelona particular dimension. 
Consider only one trait at atime. In this way a 
generally favorable or unfavorable impression 
which you may hold of a child will not influence 
your objective rating of him on each scale. Al- 
though occasionally you may feel that the child is 
best described by a point lying between two num- 
bers, please select one of the numbers. 

After selecting one number as a rating, write 
that number on the separate blank provided oppo- 
site the appropriate item number. Please do not 
write on the rating scale itself. 


I. Physical Status and Motor Behavior 


1. Physical condition and health 
1 - Weak physical system; poor health; tires 
easily 
5 - Excellent physical condition; healthy 


2. Physical coordination (gross muscle coordi- 
nation) 


1 - Poor physical coordination; awkward 
5 - Excellent physical coordination; agile 


3. Muscular control (fine muscle coordination) 


l - Poor muscular cont rol—as in drawing, 
coloring 


5 - Excellent muscular control—e. g., in 
holding crayon, chalk 


4. Ability to dress self 
1 - Unable to dress self 
5 - Very capable of dressing self; can tie 
shoestrings 


IL Social Behavior 
1. Leadership 
1 - Is lacking in leadership qualities 


5 - Possesses good leadership qualities 


2. Relationship with other children 
1- Doen't get along well with other chil- 


10. 


LL 


12. 


13. 


dren; quarrels; fights; bullies; has few 
playmates 

5 - Gets along well with other children; has 
many playmates; is well liked 


Friendliness to other children 

1 - Unfriendly to other children; hostile - 

5 - Shows open friendliness to other chil- 
dren 


Sympathy 

1 - Unsympathetic; indifferent 

5 - Sympathetic to others’ problems; co m- 
passionate 


. Consideration for others 


1 - Inconsiderate; self-centered 
5 - Considerate; thinks of others; respects 
abilities and opinions of others 


Sense of fair play 

l- Lacks a sense of fair play 

5 - Strong sense of fair play; abides by peer 
group rules and requirements 


. Willingness to share 


1- Unwilling to share; hasn't learned to 
share 
5 - Always willing to share 


Willingness to take turns А 

1 - Unwilling to take turns; impatient in 
waiting 

5 - Always willing to take turns; waits pà- 
tiently for a turn 


Ability to play in a large group š 

1 - Doesn't know how or is unable to play in 
a large group 

5 - Is able to play in a large group 


Defensiveness ds 
1 - Defensiveness—every little hit deman! 
a full battle or 
5 - Doesn't have to fight back if pushed 
hit; able to accept taunts 


Self-assertiveness 

1 - Takes a back seat; passive; can be 

5 - Sticks up for self; doesn't let others 
over him 


led 
run 


Outgoingness 

1 - Shy; bashful; timid; initiates few cont 
with other children 

5 - Outgoing; initiates many conta 
other children 


acts 
cts with 
Tendency to tattle 


1 - Frequently tattles on other children 
5 - Is not a tattle-tale 


1 


14. 


10. 


. Flexibility 
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Social independence 

1 - Socially dependent; disturbs other chil- 
dren; handles, touches them; pokes 
others 

5 - Socially independent and self-sufficient; 
doesn’t touch or feel other children 


II. Emotional Behavior 


. Happiness, cheerfulness 


1- Unhappy, gloomy disposition; whiny; 


pouts 
5 - Happy, cheerful 


. Reaction to praise and criticism 


1 - Resents correction or criticism; Over- 


reacts to praise 
5 - Takes praise and criticism in stride 


. Fears and anxieties 


1 - Has many fears and anxieties 
5 - Free of fears and anxieties 


1- Inflexible-gets upset over a change in 


the pattern of activities 

5. Flexible-if doesn't get own way, can 
modify behavior; doesn't get upset over 
a change in routine 

Reaction to failure 

1- Unableto face failure; 
with discouragement an 

5 - Courageous, perseveres in 
ure 

Emotional maturity 

l- Immature, cries easily; 
lacks self-control; babyish 

5 - Emotionally mature; stable; posses 


self-control 


reacts to failure 
d irritability 
face of fail- 


easily upset; 


ses 


Degree of tension 
1 - Tense; nervous 
5 - Relaxed 


Initial adjustment to school situation . 

1 - Initial fear of school; took a long time to 
adjust to the school situation 

5 - Adjusted readily to school; inapprehen- 


sive of school situation 


: Sense of humor 


Те Ñ f humor 
acks a sense O 
5- Possesses an excellent sense of humor 


Self-confidence 
l- Lacks self-confidence 
5 - Self-confident; self-assure 


IV. Intellectual Abilities and Behavior 


Language development 
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1 - Immature language development; unable 
to express self adequately; poor vocab- 
ulary 

5- Mature language development; able to 
talk insimple, accurate sentences, large 
vocabulary for age level 


. Creativity, originality 


1 - Few original ideas; unimaginative 
5 - Very creative; much originality, excel- 
lent imagination 


. Background knowledge and information 


1- Possesses little or inadequate back- 
ground information 
5 - Possesses much background knowledge 


and information 


. Curiosity 


1- Little curiosity; fails to explore, inves- 
tigate 
5 - Is keenly curious 


. Evaluation of own abilities and achievement 


1 - Incorrect view of ability; either over- or 
under-estimates ability 

5. Realizes own capacities and is satisfied; 
able to evaluate own achievement 


. Eagerness to learn 


1- Lacksdrive; no spark; lacks initiative to 


learn 
5 - Eager to learn; drive; initiative to work 


out own ideas 


. Speed of comprehension 


1- Slow in understanding new ideas and new 


material 
5. Catches onto things quickly; grasps ideas 


without difficulty 


. Adjustment to Classroom Membership and 


Requirements 


. Ability to listen 


1- Inattentive; dreamer; in a world of his 


own 
5 - Is a good listener; gives rapt attention 


. Cooperativeness 


1- Uncooperative; hinders group activities 
5 - Cooperates well in organized group ac- 
tivities and functions 


. Ability to follow directions 


1- Doesn't follow directions 
5 - Follows directions well 


Use of extra time 
1- Poor use of extra time; wastes time 
5 - Uses extra time well; never lacks for 
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something to do; always busy 


Acceptance of school rules 

1 - Doesn't follow rules; resents them 

5 - Accepts and obeys school rules and reg- 
ulations 


. Ability to work independently 


1 - Can't work independently 
5 - Independent; can work independently 


. Attention span 


1 - Short attention span 
5 - Excellent attention span 


. Interest in classroom activities 


1 - No interest in school nor its activities 
5 - Great interest in classroom activities 


- Distractibility 


1 - Restless; can't settle down; needs very 
varied activities 

5 - Able to work quietly for an adequate per- 
iod of time without becoming restless 


Contributions to group 

1 - Contributes little meaningful information 
to group discussions 

5 - Makes worthwhile contributions to group 
discussions 


Care of own equipment 

l- Unable to take care of personal equip- 
ment; misuses it 

5 - Competent in care of own equipment— 
e.g., crayons 


Work habits 

1 - Doesn't know what to do next; doesn't get 
Work done; messy; careless 

5 - Knows what to do at the right time; com- 


pletes assigned work; cleans u p own 
Space 


Attitude toward work 

1 - Lazy; does work poorly; complains about 
work to be done; doesn’t want to work— 
would rather play with toys 

5 - Accepts the job to be done; works hard; 
takes pride in his work 


Persistence 
1 - Lacks persistence 
5 - Always persistent 


Reliability, dependability 

1- Unreliable; unde pendable; can’t be 
counted onto carry out assigned respon- 
sibilities 

5 - Reliable; dependable; sense of responsi- 
bility; able to take responsibility in the 


room 


16. Acceptance of role as group member . 
1 - Displays continual attention-getting be- 
havior | 
5 - Fits into classroom affairs without de- 
manding undue attention from teacher or 
from peers 


17. Sense of responsibility to group and to teacher 
1 - No sense of responsibility to group or to 
teacher 
5 - Strong sense of responsibility to group 
and to teacher 


18. Attitude toward school property Р 
1 - Destructive of school property апа equip- 
ment 
5 - Strong sense of responsibility towards 
school materials and property 


19. Acceptance of teacher’s role | 
1 - Rebellious against authority; defiant 
5 - Accepts teacher's (authority) role 


Inter-rater reliability co efficients were үз 
tained for the five sections of the scale and for 
full scale from the ratings of one first-grade 
class consisting of twenty-five children by i 
practice teachers in the University of Minneso ë 
Elementary School. The teachers had had aen 
months of practice teaching experience with e 
group. This original group of children is ens 
the “pilot group” to distinguish it from the “stu | 
group” of first graders for whom the adjustme! 
Scale was designed. 


Description of Subjects 
— Pn 01 subjects 


The adjustment scale was used to rate п. 
subjects in the larger study dealing with ure s 
grade readiness and adjustment. A brief desc! я 
tion of these children will be given. The cco 
of the field study was a small midwestern co 
munity of approximately 5000 residents. Noe 
the subjects had had previous kindergarten ехр 6 
lence. Thirty-five first graders, 19 boys a : 
girls, comprised the study group. The mean rd- 
of the group was 111. 6 according to the Stanfo 
Binet (Form L) intelligence test administer 0 
the investigator. The socio-economic pee" 
the children's families was approximately middle 
divided betweenthe upper-lower and lowe tus 
classes ac cording to Warner’s Index of see 
Characteristics (3. Twenty-five of the subj ағ 
comprised one first-grade classroom. THP pet 
maining ten subjects were members of ano 
first-grade section. 


of 


Analysis of the Data 
— 525 01 the Data 


the 
The adjustment ratings were made PY 


` 
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йы teacher during the last month of the 
aia ie year. The adjustment scores were 
Ше ou in relation to the C. A.’s and LQ.'s of 
metit BA ets: The difference in the mean adjust- 
siguitie ores of the boys and girls was tested for 
im: ange: In addition, the scores of the pilot 
inn e e related to ratings on the Haggerty- 
ШОС. ickman Behavior Rating Schedules made 
e kindergarten year. 


Results 


T Table I lists the inter-rater reliability coef- 
ents which were obtained. 


TABLE I 


INTER-RATER RELIABILITY COEFFICIENTS 


Adjustment Scale Sub-areas Г 
ü Physical Status . T0 
m Social Behavior . 10 
ty, Emotional Behavior „12 
V. Intellectual Abilities 18 

* Adjustment Classroom Requirements i: 


Full scale 


relation coefficient of 
e first-grade adjust- 
d their Haggerty- 
he kindergarten 
ected direc- 


-.52 ss product-moment cor 
ment d obtained between th 
fee atings ofthe pilot group an 
n-Wickman ratings made in t 


ye 
Hon: . The correlation is in the exp a 
since, in contrast to the First Grade Adjust- 
her Haggerty-Olson- 


m 
Sis Scale scores, the hig! : 
man scores indicate poor adjustment. t 
me The correlations computed between oet 
rou, Scores and C.A. and L Q. for the study 
Spec? Were 4.21 and +.42, respectively. The гес 
te mean ratings of the boys and ge ae 
167 and йу a; the TARSO ge ead or 
u ^ eo 
pwas from 74 to 253. he tween unre- 


the A E 
late significance of the differens 
ti difference was not sta- 


tist means for the sex 
tally significant. 


Discussion 


"n Р ight be desired, the 
йер He not as high as с bs were of such 


rate еч, кле 
= ater reliab coeffici à 
amo atude as ps p eats at least а moder ate 
ches of agreement inthe way in 
Of fir TS view the specific behaviors 
the ojj rade children. Longer asso 
ry by the practice teachers 
d to higher coefficients. — .. : 
© correlation between the first-& 


of a group 
ciation with 
might well 


tea, 


ade ad- 


justment ratings of the pi 
[Un em искус десш: r ks Mower eee 
ү ergarten year indicate a fair agreement s 
een these two measures, especially i x xen 
the fact that the tworatings were made ie diffe E 
ent raters and were separated in time b zu 
a year. Thus, the present scale is veo Keri d 
related to a known measure of adjustement ane 
А While the correlation betweenI. Q. and tl 
justment ratings suggests that i s ae 
a significant part in the child's adjustment pays 
apparent that intelligence alone does not p vin 
for a great deal of the variance in the cube eai 
Scores. One might speculate, certainly dee E 
ing the importance of general emotional m pups, 
drive for achievement, and so forth SEN 
While the mean rating of the Bo 
that of the girls, the difference ios ae alata 
cally significant. This is somewhat cont esi 
expectation since more boys than girls are an ed 
identified as poorly adjusted by the clas Me 
teacher. In an attempt to examine the ебине 
closely inthis regard, the differences in the Suns 
ratings of the boys and girls for the five sub ш е 
were tested for significance. Again councils 
t’s were statistically significant, 'althou eh 
greatest difference was obtained for the атса, Pon 
justment to Classroom Membership and Requi E 
ments. This would seem in line with the notion 
that boys experience more difficulty than girl 4 
adjusting to classroom routine and to the a vr m 
which шры the school situation. oan 
Several advantages oft i 
mentioned. First, the о ponis ре 
end points of each scale are not so ene E 
a rater would hesitate to assign a child dogs 
rating. Second, thelanguage and terminolo es ul 
ployed is understandable andmeaningiulio të he 
ers since for the most part the items are ph: eS 
inwords actually used by first-grade anim 
And, third, first-grade children can be rated m. 
out difficulty on all of the items; this stem ons 
from the fact that theitems included in the. des 
scale emerged from discussions with first uo 
teachers. Bl Brade 
The First Grade Adjustment 
value to the а е Бо 
ferences With parents, especially inthe abe сте 
held at the end of the year. The scale hen in 
helpful in pinpointing general as wellas s > | а 
агеаѕ ої меакпеѕѕеѕ апа strengths. Also Гон 
oyed inthe larger study of first-grade MS 


ploy 
ment, the scale is useful in a number of researcl 
1 


areas. 


summary_and Conclusions 


The present paper described the à 
of a First Grade A dju s t m ent Pus точ 
consists of 52 items of behavior, grouped i Au e 
major areas, obtained from interviews with 25 
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first-grade teachers. 

The scale was used for rating two groups of 
first graders, a pilot groupand a study group, to 
obtain reliability and other data. The children’s 
scores on the scale were examined in relation to 
C. A., I.Q., and sex differences. 

The following results emerged from the 
study: 


1. The inter-rater reliability of the full 
scale was . 77. 

2. A correlation coefficient of -.52 was ob- 
tained between the first-grade adjustment ratings 
of the pilot group and their Haggerty-Olson-Wick- 
man ratings made in the kindergarten year; this 
was in the expected direction. 

3. Coefficients of +. 21 and +. 42 were ob- 
tained between the adjustment scores and C. A. 
апа І. ©. respectively, for the study group. 


4. The respective mean ratings of the boys 
and girls were 168. 72 and 183. 35. 


Several uses of the scale for the classroom 
teacher and the researcher were discussed. 
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A STUDY OF ACHIEVEMENT AS A FUNCTION 
OF HOMOGENEOUS GROUPING 


WILLIAM F. 


KOONTZ 


Norfolk County Schools, Norfolk, Virginia 


FOR MANY years, our public schools have 
recognized that pupils have a wide range of abil- 
ities, interests, and degrees of motivation. In 
Order to provide for these individual differences, 
many schools have grouped their classes homo- 
&eneously. 

Early attempts at class grouping were execut- 
€d with no empirical proof of its efficacy; and e- 
Ven today, there is inconclusive evidence as tothe 
instructional value of homogeneous grouping. 

Approximately 25 years ago, it was reported 
that the literature related to homogeneous group- 
ing had been carefully reviewed, and the most sig- 
nificant conclusion from it all was how little it 
had “brought of clearly incontestable knowledge'' 

Professor Passow, in1956, stated that there 
Was no ‘significant unanimity of findings" in this 
area (2). One critical evaluation and synthesis of 
the research indicated that the evidence slightly 
avored homogeneous grouping where adaptation 
of teaching methods had accompanie dit. But 
here is inadequate evidence as to the proper ad- 


aptations (1). 


Purpose and Procedure 


h The purpose of this study was to test the null 
YPothesis that children grouped hom ogeneously 
Y Subject matter achievement, and who were 
iR instructional materials on their achieve- 
ent level, would show no greater achievement 
Š à result than pupils who were grouped hetero- 
Seneously and followed a regular course of study. 
in During the 1959-1960 school session, pupils 
five fourth-grade classes at Deep Creek Ele- 
рагу School participated in the study аз eX- 
tetea tal subjects. Control subjects were Se 
€d from the fourth grades of two other Norfolk 
"ALI Schools. 
е close of the third grade, 
Bid Control pupils were given the Iowa Tests of 
for 1С Skills. Grouping of experimental classes 
e 9urth-grade study was effected through the 
group. Scores from this test. Homogeneous 
PS Were formed in three areas: arithmetic, 


experimental 


language, and reading. А11 experimental pupils 
were listed in rank order in terms of their grade 
equivalent scores. The members of a class were 
chosen then by selecting the top 20 percent, the 
second 20 percent, and so on. Pupils were placed 
in arithmetic class on the basis of their arithme- 
tic scores, in language class onthe basis of their 
language scores, and in reading class on the ba- 
sis of their reading scores. Some pupils who 
were in the highest reading class were only aver- 
age in arithmetic; therefore, they would be ina 
lower arithmetic class. Asa result, it was ne- 
cessary for these pupils to change c lasses for 
study in the three areas mentioned. For study in 
areas other than arithmetic, language, and read- 
ing, the groups remained intact and did not change 
classes. 

At the beginning of the fourth grade, it was 
found that one e xperimental class, on the aver- 
age, was achieving at thefifth-grade level; there- 
fore, fifth-grade materials were provided. Two 
classes were given fourth-grade materials and 
two classes were given third-grade materials be- 
cause of their levels of achievement. 

Control pupils were matched with experimen- 
tal pupils in each of the three areas. The com- 
parability of these twogroups in terms of a- 
chievement at the beginning of the experiment 
may be seen from an inspection ої TablesI, П,апа 


HI. 

Schools in which control pupils were enrolled 
had no knowledge that the experiment was being 
conducted. Control pupils were grouped hetero- 
geneously, and all of them followed the usual 
course of study with fourth-grade materials being 
provided. 

Achievement of the experimental and control 
groups was measured at the close of the fourth 
grade with the lowa Tests of Basic Skills. 


Analysis of Results 


The analysis of data was accomplished by a 
treatment by levels analysis of variance design. 
By constituting different levels in the analysis, 
it was possible to determine if any interaction 
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TABLE 1 


BEGINNING MEAN GRADE EQUIVALENTS-ARITHMETIC 


Grade Equivalent Range Experimental Mean Control Mean 
Level 1 4.6-5.4 4.96 5. 00 
Level 2 4.2 - 4.6 4.43 4.39 
Level 3 3.6 - 4.2 3.93 3.93 
Level 4 2.3 - 3.6 3.10 3.16 
Total 2.3 - 5.4 4.11 4.12 

TABLE II 
BEGINNING MEAN GRADE EQUIVALENTS-LANGUAGE 

Grade Equivalent Range Experimental Mean Control Mean 
Level 1 4.5 - 7.0 5.15 5.15 
Level2 3.9-4.5 4.21 4.20 
Level 3 3.5 -3.9 3.69 3.70 
Level 4 1.8 - 3.3 3.00 3.04 
Total 1.8- 7.0 4.01 4.02 

TABLE Ш 

BEGINNING MEAN GRADE EQUIVALENTS-READING 

Grade Equivalent Range Experimental Mean Control Mean 
Level 1 4.6 - 6.9 5.53 5.52 
Level 2 3.8 = 4.6 4.20 4.19 
Level 3 3.2-3.8 3.50 3.52 
Level 4 2.3 = 3.2 2.89 2.89 
Total 2.3 = 6.9 4. 03 4. 03 
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TABLE IV 


FINAL MEAN READING GRADE EQUIVALENTS 


N per Cell Experimental Mean Control Mean Difference Between Means 


Level 1 27 6.17 6. 36 .19 
Level 2 27 5.28 5.75 . 47 
Level 3 27 4.57 4.95 . 38 
Level 4 27 3.94 4.57 .63 

4.99 5.41 .42 


Total 108 y 


Leve] 1 
Leve] 2 
Leve] 3 


Leve 14 


TABLE V 


SUMMARY TABLE - READING 


Source df SS MS F 
___ L. ———— 
А 1 9.54 9.54 10.36* 
L 3 124. 97 41. 65 45.27* 
AL 3 1.41 . 47 .51 

w cells 208 191.64 .92 

Total 215 3271.56 


* Significant at the . 01 level of confidence. 
TABLE VI 


NAL MEAN ARITHMETIC GRADE EQUIVALENTS 


FI 


Control Mean Differences Between Means 


Experimental Mean 


N per Cell 
4 5. 66 5.95 .29 
2 А 
5.40 “11 
5.29 
24 
5.24 ‚29 
4.95 
24 I 
4.50 . 48 
4.02 
24 
5.27 .29 
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TABLE VII 
SUMMARY TABLE - ARITHMETIC 
Source df SS MS F 
A 1 4.14 4.14 11. 18* 
L 3 60. 94 20.31 54.89* 
AL 3 .82 .27 ‚72 
w cells 184 67. 82 „ВТ 
Total 191 133. 72 
* Significant at the . 01 level of confidence 
TABLE VIII 
FINAL MEAN LAUGUAGE GRADE EQUIVALENTS 
N per Cell Experimental Mean Control Mean Difference Between Means 
Level 1 29 6.79 6. 67 . 12 
Level 2 29 5.49 5.65 .16 
Level 3 29 4.90 5.23 „38 
Level 4 29 4.36 4. 48 12 
Total 116 5.39 5.51 .12 
TABLE IX 
SUMMARY TABLE - LANGUAGE 
Source df SS MS F 
A 1 .84 .84 1.00 
L 3 166.18 55.39 65.94* 
AL 3 1.53 .51 60 
w cells 224 188. 71 .84 
Total 231 357.26 


* Significant at the . 01 level of confidence. 


r= 
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were present. Or, in other words, did the ex- 
perimental treatment produce an effect at one 
level of achievement but notatthe others? To il- 
lustrate further, perhaps the experimental treat- 
ment had a positive effect on the low and high a- 
Chievers but not on the average achievers. 

Table IV on the next page shows the final mean 
grade equivalents achieved by the experimental 
and control groups in reading. 

It is apparent from Table IV that the control 
group's final reading achievement was higher than 
that of the experimental group. Over all, there 
was a difference in achievement of approximately 
four months between the two groups. Also, the 
difference was in favor of the control group at all 
levels. The question to be answered is whether 
the differences between the groups are statistic- 
ally significant. The data in Table V, next page, 
presents in summary form the ana lysis of vari- 
ance which answers this question. 

«А in Table V represents the treatment 

groups, i.e., experimental and control, and the 
Variance for A was significant at the .01 level. 
This suggests the probability is only one in a hun- 
dred that the total difference between these two 
£roups is due to chance. 
. “L represents the level ofachievement. The 
information in Table V indicates that there was a 
Significant difference between the means (which 
includes both the experimentaland the control 
Scores) of the levels. It is tobe expected that the 
variance would be significant here. 
ü “AL” denotes the treatment by level interac- 
ion. The variance for this category is not sig- 
nificant, Therefore, we must accept the hypoth- 
esis that no interaction is present. This is to say 
that the two treatments did not have significantly 
different effects at the different levels of achieve- 
oe In other words, the groups reacted essen- 
ially the same at each level. y 

Table VI presents the final mean grade equiv- 
cents for arithmetic. Higher a rithmetic a- 
1 ievement was made by the control group at all 
eee as revealed in this Table. Overall, there 
pere approximately three months: difference in 
avor of the control group. The information in 

Able VII is a summary of the analysis of vari- 


"its for these data. 
TNR in Table VII represent 
SOUPS and the variance here 15 78-3: 
that level of confidence. Again, this ndicates 
the үеге is only one possibility ina 
could Le mean difference between th 
"A € due to chance. 

Varia L” represents the trea 
Sain pee for this category is П 
dig, iS Suggests that there 

ence in the way the grou 


e two groups 


tment by levels. The 
ot significant. A- 
was no significant 
ps reacted at the 


different levels. 
А Table УШ shows the final mean achievement 
in language. The control group’s total mean 
grade equivalent exceeded that of the experimen- 
tal group by approximately one month. At Level 
1, the experimental group's mean was roughly one 
month higher than that of the control. Table IX 
presents the analysis of variance of these data. 
The variance for A in Table IX indicates that 
the total difference between the two groups was 
not statistically significant. The AL variance is 
also non-significant. Therefore, we may conclude 
that there were no realdifferences inthe language 


achievement of the two groups. 


Summary and Conclusions 


The purpose of this experiment was to test the 
null hypothesis that fourth-grade pupils group ed 
homogeneously by subject matter achievement, 
and who were given materials and instruction on 
their achievement level, would show no greater 
achievement than pupils who were grouped heter- 
ogeneously and who used only fourth-g rade ma- 
terials. On the basis of the evidence gathered in 
this study, this hypothesis cannot be rejected. 
Here, too, as in many other studies, homogene- 
ous grouping failed to realize its theoretical pos- 
sibilities. 


Experimental and control pupils were closely 


matched in terms of achievement at the beginning 
of the experiment. However, itmay be that many 
variables that need to be controlled in experimen- 
tation with human behavior evaded control in this 


study. 
tical possibility still exists that ed- 


The theore 
ucational experiences can be made more pointed 
and more meaningful when teachers canplan them 


for a class with a narrower range of differences; 
but in order to resolve this question, further ex- 
perimental evidence is necessary. 


REFERENCES 


Monroe, Walter S. (Editor), *Ability Group- 
ing," Encyclopedia of Educational Research, 
New York: The MacMillan Company, 1941, 


p. 440. 
2. Passow, Harry A., “The Enrichment of Edu- 


cation for Gifted Children, ` Fifty-seventh 
Yearbook of the National Society for the 
Study of Education, 1958, p. 20. 

Raup, R. Bruce, “Some Philosophical As- 
pects of Grouping, " Thirty-fifth Yearbook 
of the National Society for the Study of Edu- 
cation, Part I. Bloomington, Illinois; Pub- 
lic School Publishing Company, 1936, pp. 


43-56. 


JOURNAL OF EXPERIMENTAL EDUCATION 
(Volume 30, Number 2, December 1961) 


THE INFLUENCE OF MENTAL ABILITY ON 
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STATUS IS CONTROLLED 
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BOTH MENTAL ability and socio-economic 
Status have been found to correlate moderately 
With criteria of academic achievement (Lennon 
and Schutz, 2; Warner, Meeker, and Eells, 5). 
Unfortunately, the interpretation of these findings 
15 complicated by the correlationof similar mag- 
nitude between mentalability and socio-economic 
Status (Knief and Stroud, 1). McClelland (3) has 
attempted to account for this triangle of relation- 
Ships by suggesting that mental ability may func- 
tion as a “threshold” type variable with respect 
to academic achievement. That is, acertain 
minimal level of mental ability may be required 
to achieve in school. Beyond this point, however, 
the obtained correlation between intelligence and 
Achievement may be due to uncontrolled variabil- 
ity on factors such as socio-eco nomic status. 
Consistent with this hypothesis is Terman and o- 
den's (4) finding that, given a high level of intel- 

gence, successful and unsuccessful individuals 
differ primarily in terms of socio-economic fac- 
ors, 
» The present study was a 

ether mental ability exer 1 
School performance irrespective of socio-eco- 
nomic status. Specifically, the study tested the 

YPothesis that the academic achievement of pu- 
Pils with “average” and “high” mental a bility 
does not differ significantly when socio-economic 


S F 
tatus is controlled. 


Sample 
ingle elementary 


All Ss w 

ere selectedfrom a $ € 
caon] district. The district is located in ie 

ee of a metropolitan comm unity of abou 
Dro; 000 population and has an enrollment of ap- 
nq mately 13,000 in grades one to eight, at 
116 25 se its. The sample 

parate school uni 
àS Selected from Caucasian eighth grade pupils 


* 


nattempt to determine 
ts an influence on 


Sc 


Footnotes appear at the end of the article. 


who ranked at the fifth, or at the eighthor ninth 
local stanines on the California Test of Mental 
Maturity, Short Form Total IQ (CTMM) and who 
had complete test results on the California A- 
chievement Tests, Intermediate (CAT). All 93 
pupils who had CTMM stanines ofeight or nine 
were included in the study, forming a “high” 
mentalability group. A total of 121 pupils ob- 
tained CTMM stanines of five. Of these, 28 were 
randomly eliminated to form an “average” men- 
tal ability group equal in size to the “high” group. 


Procedure 


Warner's Index of Status Characteristics (ISC) 
was used as a measure of Socio-economic status, 
Father’s occupation and sources of income were 
taken from the pupils’ cumulative records. 
Dwelling area rating was derived from a large 
map of districts which had been subdivided ac- 
cording to Warner’s desc riptive criteria by the 
consensual judgments of six district school ad- 
ministrators and supervisors. 

Both the CTMM and the CAT were adminis- 
tered in the second month of the eighth grade as 
part of the regular district testing program. The 
CTMM IQ’s for the *high" mental ability group 
ranged from 116 to 142, the “average” group 
from 97 to 102. The six major sub-tests of the 
CAT were used as achievement criterion mea- 
sures. 

To obtain a criterion that would be somewhat 
broader than the results ofastandardized a- 
chievement test, a teacher rating was obtained 
for each pupil. Teachers were requested to give 
a global rating «which reflects your estimate of 
the pupil's current overall academic achieve- 
ment." A five-point scale was used with su- 
perior achievement given a rating of five and poor 
achievement a rating of one. Ratings were ob- 
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MEANS AND STANDARD DEVIATIONS OF THE VARIABLES FOR “HIGH 


TABLE I 


AND “AVERAGE’’ MENTAL ABILITY GROUPS 


Variable 


CAT Vocabulary 


CAT Reading Comprehension 


CAT Arithmetic Reasoning 


CAT Arithmetic Fundamentals 


CAT Mechanics of English 


CAT Spelling 


Teacher Rating 


ISC (Warner) 


CTMM 


Group Mean SD 

High 13.39 6. 99 
Average 57. 87 10. 41 
High 43.46 4. 92 
Average 33.67 US i 
High 40. 36 6. 34 
Average 29,73 7. 88 
High 64.26 10.95 
Average 49. 66 11.15 
High 52.47 5.60 
Average 45.54 7.30 
High 23.09 6.14 
Average 18.12 6.52 
High 4.12 0.64 
Average 2.95 0. 85 
High 44.34 11. 51 
Average 59. 62 11. 63 
High 121.33 5. 35 
Average 99.28 1.59 


s U ———————— 


— Ge ae em 


au 


BAKER - SCHUTZ - HINZE 257 


TABLE II 


ANALYSES OF COVARIANCE 


Residuals 


MIN Total SS Within SS Within MS F 1,183 

CAT Vocabulary 19, 903. 37 14, 030. 60 76. 67 76.59 
CAT Reading Comprehension 9, 856. 34 6, 960. 37 37.97 76.27 
CAT Arithmetic Reasoning 12,376.70 9,320. 98 50. 93 60. 00 
CAT Arithmetic Fundamentals 27, 123. 82 21,204. 78 115.87 51. 08 
CA T Mechanics of English 8,995.91 7, 131. 73 42.28 29. 76 
CA T Spelling 8,013. 25 7,359. 84 40. 22 16.24 

145. 67 104. 27 .57 72.63 


Teacher Rating 


tained in the eighth month of the eighth grade. 
ine relevant data for each S were punched into 
su Cards. The means, standard deviations, 
Š ims of measures, sums of squares, andsums of 
dn products of all variables for each mental 
ility group and for the total sample were com- 
Puted, using an IBM 704. ** 
f analysis of covariance Was used to control 
Whi any group differences in socio-economic status 
Er ich existed between the two mental ability 
вос Ра Thus, mental ability was restricted and 
of io-economic status was controlled in analyses 
io Covariance involving seven achievement criter- 
n variables, 


Results 


io able I shows the means and standard devia- 
on а of all measures for both groups. Note tha 

group achievement measures, the “high ability 
Const; has considerably higher mean scores ш 

Тһе itutes a slightly more homogeneous sample. 
how Variance of the “high’’ ability group may, 
Nena be spuriously curtailed by the ceiling 
m of the achievement measures involved. 


the L. у: е сазе of socio-economic status, maps 
er mean group score denotes high 507 
aa score of the high 


abing E on the ISC. The mean bri 
Class, STOup (44. 34) represents а “lower mi I 
Position on the ISC. The mean rating 0 
teenage” mental ability gr oup m. 62) rep- 
an “upper- r class” position. 
Com e Settle ene amore the varia ble s m 
Since 769. The coefficients are SP UF iously hig 
Only the tails of the distribution are involved. 


Nevertheless, the obtained coefficients suggest 
upper bounds which can be compared with the find- 
ings of other studies. Product-moment coeffi- 
cients were computed between soc io-economic 
status and each of the seven achievement criteria. 
The r's ranged from a low .23 for Mechanics of 
English to a high of . 47 for Vocabulary. Biserial 
coefficients were computed between mental ability 
and allother variables. Anr of . 68 was obtained 
between mental ability and socio-economic status. 
The r's between mental ability and achievement 
criteria ranged from . 46 for Spelling to . 82 for 
Vocabulary. 

Table П shows the analysis of covariance data 
and resulting F-values for each criterion measure. 
It will be noted that all F-values are statistically 
significant at the .01 level of confidence. There- 
fore, the differences in measured achievement of 
pupils in the “high’’ mental ability group and pu- 
pils in the *average" mentalability group are 
significant even after adjusting for individual dif- 
ferences in socio-economic status. 


Discussion 
Discussi0" 


The results of the study suggest that at least 
insofar as academic achievement is measured by 
standardized tests and teacher ratings, intelli- 
gence does influence achievement even when dif- 
ferences in socio-economic status have been con- 
trolled. However, before one genera lizes too 
widely, the findings of this study should be qual- 
ified by several limiting points. 

First, the findings might not hold true for all 
ranges of IQ. The pupils in the high" mental 
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ability group might have been bright enough in 
this school district to “stand out. " Possibly, if 
one compared the stanine seven pupils with the 
stanine fours rather thanthe eights and nines with 
the fives, the results would differ. 

A second point concerns the age of theSs. 
Were one to study older high school students, or 
the younger elementary ages, the results might 
differ from those found witheighthgraders. This 
might be particularly true at the high school lev- 
el, for it is there that the pupil begins to become 
more directly involved with the ‘‘what the future 
holds. " 

A final limiting point concerns the levels of 
Socio-economic status involved in this study. The 
average ISC for the ‘‘high’* ability group in this 
district is at the lower middle class level. Had 
a greater number of pupils atthe higher socio-e- 
conomic levels been represented, the results 
might have been different. It should be pointed 
out, however, that while the central tendency of 
ISC rating might be considered somewhat low, 
variability is relatively high. 


Summary 


The study tested the hypothesis that the aca- 
demic achievement of pupils with ‘‘average’’ and 
**high" mental ability does not differ significant- 
ly when socio-economic status is controlled. A 
sample of 186 eighth grade pupils took part in the 
study. Ss were assigned toa “high'' or an “ау- 
erage’’ mental ability group. Socio-economic 
status was controlled in analyses of covariance 
involving seven achievement criterion variables. 
For each criterion, evidence was obtained to re- 
ject the hypothesis at the .01 level. The two 
mental ability groups differ significantly on all a- 


chievement criteria even after adjustments are 
made for individual differences in socio-econom- 
ic status. 


FOOTNOTES 


* Now at Marin County Schools, San Rafael,Cal- 
ifornia. А 

** This work was done at ће General Electric 
Computer Center, Arizona State University. 
We wish to thank Thomas Lahey, R obert 
Stas, and Donald Maurer for their coopera- 
tion and assistance. 
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EARLY FAILURES IN LIFE TESTING: 
COLLEGE ATTRITION 


FRANK B. BAKER 
University of Wisconsin 
ROBERT E. McCLINTOCK 
University of Maryland 


Introduction 


‘hae EVALUATION of manufactured goods by 
ensiy н life testing procedures has been used ex- 
plished y in industry. Such life testing is accom- 
Conditi by subjecting a number of units to operating 
пире SMS over a period of time and recording the 
elegan of units failing in each of the several time 
Curve als. From the resulting data the reliability 
Colle andan estimate of the failure rate is obtained. 
Pear Cx attrition data have characteristics which ap- 
life t 0 be very similar to those yielded by industrial 

esting, A group of freshmen enter a college 
Period. Subjected to the rigors of college life over a 
Perioq Of time, In the subsequent scholastic time 
ue to S fewer and fewer of the original group return 
End or dents terminating their programs. At the 
tounge © Years, the usual period of time devoted 
Survive t graduate study, a number of the students 
colles. 10 Obtain their diplomas. The similarity of 
t 2 attrition and industrial life testing suggested 
бусу. thors that college attrition could be effec- 
life teg aed using the statistical methodology of 


pstein and Sobel [3] 


density for duration 
nential with pa- 


In 9" 

вте fundamental paper, Е 
Of life dthat the probability 
ameter paänufactured goods is expo 


т. 
r(tsA)dt = ле-м at, t 20, (1) 


Ang 
the i . 
Maximum likelihood estimate of № 15 


| 
= gn 0. (2) 
wh Ë i + (N - nT, 
ere Ni 


(t S the sample size, 
1 | | 
"m „dered times of failure, 
i ale oe terminated, 


1 is 
the time at which the test was 


is t 
р 6 ма Number of failures up to time Tre 
bi i "mn 
Бар ability of a component is specified as the 
Y that the component will survive a speci- 


+ 
In 
eth 
lent area of lif ы eter of the 
, ife testing the param terner | 
0 


e] 1 
Nave chosen the notation 


fied period of time. Hence, the probability of sur- 
vival plotted against time yields the curve of relia- 
bility, i.e., survival. 

R(t) = e^t (3) 

A recent extension of the work of Epstein and 
Sobel has been published by Miller [5]. In this re- 
cent work, two types of manufactured goods were 
postulated: those manufactured according to speci- 
fications and those not manufactured according to 
specifications. The probability densities of life 
duration for each is exponential in character; how- 
ever, thedefective goods will fail rapidly during the 
early time intervals oflifetesting. The model pos- 
tulated by Miller takes into account the presence of 
‘early failures" in the sample by allowing the fail- 
ure rate à to vary witht. Thus, 


[50,0 = t€To 
Sd EI Tos t €T, (4) 
where: №, is the failure rate due to “early fail- 


игез”, 
^, is the failure rate due to proper manu- 


facturing, 
To is the time beyond which a failure is not 


considered to be an “early failure", and 
à > Az 


Although Miller presents the theoretical deriva- 
s for both large and small samples, we shall 
consider only the large sample resultsfor the situ- 
ation in which the test is terminated at time T, and 
failures prior to time To are considered “early 
failures’. Further, it is necessary to assume that 


tion: 


exponent 
5] throug 


the sample has not been subjected to pretesting to 
remove materials having obvious defects of any 


kind. 
For this situation, let T* be the time of failure 


for any particular unit. When T* =t <T,, the unit 

failed during the test, and 5 
= ete ; OST 

Byala At . Tox (Тој Tot cT, 


on is often given as 1/0; however, for conven- 


jal functi 
: e relationship > = 1/9. 


hout, using th 
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FIGURE 1. 


GRAPHIC REPRESENTATION OF CURVES OBTAINED FROM THE PARAMETER 
ESTIMATES AND OF THE EXPERIMENTAL DATA 
(The small circles represent the experimental data. ) 
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When T* = T, the unit has survivedthe test by func- 
tioning to the time of test termination, and 


Px (T* = Ti = e То-^:(Т,-То), (6) 


Under the early failure model, then, the probability 
distribution of T* is given by equations (5) and (6). 

Inthe case where To is known, the maximum 
likelihood estimates of the parameters X, and X; 


t r 
x = —— r<N (7) 
> tj + (N - r)To 
i=1 
n-r 
n ; rXN 
В .Z (ti- Tg) +(N-n)(T, - To) 
X.- i=r+1 (8) 
undefined ‚ rzN,; 


where r is the number of subjects failing prior to 
the cut-off time To. 

Miller [5] has also shown that for N->o thees- 
timates X, and A, are each norm ally distributed 
with mean №, and №, respectively and variances. 

2 >: 

б = — Ə<—Ə` — , 

N(1 - e7*1 To) " 


oi = ы . (10) 
Ne > Tor _ esl T, - To], 


He further indicates that ‘‘for sufficiently large N 
an approximate confidence region with coefficient 
1 - a consists of those points (5, , X.) satisfying the 
following two sets of inequalities: 


JNA, -A)0 - e То)? 


at, = Ka, (11 
oc Y = Ko. ) 
Eas ҮЧ, - х )ет^ To/2( 1 - e->2 (T, - To)] 2 
№ 

= Ка, (12) 

where Kq is given by 

Ka 
Ize = 1⁄3 2 е“? a. азу 
-Ka 


The early failure model proposed by Miller is 
especially appealing when cons idering analysis of 
college attrition data. The entering freshmen could 
be considered to be composed of two types of stu- 
dents: potential graduates and potential non-gradu- 
ates. The duration of college attendance for the 
former group would have an exponential probability 
density with parameter X2. The latter group would 
be expected to leave college at a high rate the first 
few semesters of college, hence, would constitute 


Miller's “early failure’’ group with parameter >. 

In the past, the approaches to the analysis of col- 
lege attrition have generally followed two techniques. 
One, a demographic approach in which proportions 
of students surviving are reported by size of college, 
type of college, and geographical area, as exempli- 
fied by the excellent study reported by Itfert [ 4] . In 
the second approach, freshman entrance examina- 
tion scores and/or psychological test scores are 
compared for those students leaving college with 
those remaining. This second approach accounts 
foralarge proportion of the 156 studies listed in 
Iffert’s report. 

Although both the demographic report an 
comparison of scores are useful, neither Sup 
a mathematical model for the process of colleg ü 
trition. The question of an appropriate mathem?.. 
ical model and its application to decision making `” 
a fundamental one. The postulationof an appropri 
ate underlying model would permit attacks on suc 
questions as: How many of this fall's freshmen "ine 
be enrolled next fall? Are the attrition rates of "a 
several units within a college significantly diffe : 
ent? Do attrition rates differ from year to year 
my institution? Do college attrition rates betw 
colleges show marked differences or en et сне 

In the sections following, questions suchas Dite 
will be approached through t he methodology of 
testing. 


d the 
plies 
e at- 


een 


Application of the Model 


» model (0 
divi si? 

tio" 
pear 


The application of the **early failure 
college attrition involves establishing the ә 
point T, as the time beyond which no term} na 
can be considered as an “early failure." It n 
likely that this division point would vary from Hg- 
tution to institution as a function of screening fs" 
cedures, structure of curricula, and academ ie, 
missal policies. Various institutions wout 
pected to establish widely variant values of pplied 

In the present case, the model has been ei of 
to an entering freshman group at t he Univera this 
Maryland. The generalselection procedures © js 
state university are such that an e tering D. pre 
heterogeneous and meets the assumption О. and 
selection of elements. The presence of spec regi 
and rigidly held academic requirements се cour 
trations in upper level (third and fourthy ea е i > 
ses suggested that survivalto register pie yale 
semester implied potential graduation. > 
of To was therefore established as the be£ le 
the fifth semester. In the ordered samp 1ź n 
served terminations, t,=t,<... Str < ToS Urt Give? 
... <tn<T, (where t, is the beginning © g pe 

= = š °. curr je 
Semester), the first r terminations, oc sU hi 
fore the fifth semester, are “early failure" | ow. 
the last n - r terminations, occurring at belore Hn 
ing the beginning of the fifthsemester ри meee "and 
end of the test period, are not “early failu #7 

Our estimation of the parameters №: nts, ар 
based upon a random sample of 438 stude 


int 
nnine p- 
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proximately 15 percent of the freshman class at the 
University of Maryland at the beginning of the fall 
semester of 1957. The number of students leaving 
the University for each semester was found by de- 
termining the number of students inthe sam ple 
present at the beginning of each successive semes- 
ter after the initial point of the study. It should be 
noted that the tracing of these 438 students through 
four years of college does not represent the propor- 
tion of a given entering class who will eventually 
gain diplomas. Students who transfer to other in- 
Stitutions, possibly graduating there, and students 
Who return after being out of school for one or more 
Semesters were not counted as survivors. Thus, 
the test of the model was based only on those sub- 
jects who were freshmen at the initial point of the 
we and who were still present at the beginnings 
the seven following semesters. 
ma O? Putations of the maxim um likelihood esti- 
est s from equations [7] and [8] produced a point 
em E ofÀ, = 0. 208 andÀ, = 0.144. Figure 1 
ed d à graphic representation of the curves obtain- 
rom the parameter estimates and the experi- 
Mental data, 
is ba. sample size was deemed 
gion Oy the suggestedapproxim 
ES is Miller (5) from equations [11] , Ë 
öle ы previous page. Using a со nf idence coeffi- 
elu) of 0. 95, the obtained region was found to in- 
de 0.185=>, =0. 238, 0. 1162»; Z 0. 177. 


llustrasi: 
“stration of Comparison 


trato Problem area known to every college adminis- 
riculu is the changing in academic program or e 
Care m by numbers of students during their co - 
lite ra s. As an illustration of the application o° 

esting technique, we have approached à typica 


Quest; : у 
еце а in this area: Does the survival curve of 
п in a given academic 


ents wh P А 
Propp o begin and remalr 
le gram differ from the survival curve of an unse- 


rando f students ? 
Ir m sample of S 1 N 
! Order to answer this question, a second ran 


^ М 
the , ample (independent of the sample from which 
Stimates of the of the parameters A, and X> 


sufficiently large 
ate confidence re- 
11], [12], and [13] 


Wer ` 
ing mo tained) was selected fr o m the a hg 
esh ; ribed. In tn 
S; man " sly desc Е 
class previously isi 


ple singe MES 
ed of . Of 216 freshmen, а «termination 
Perigg Change in academic program. Data over ше 
With ¢ of the eight semesters was then com on 
9f th, © theoretical curves generated by applica ion 


*arly failure model to the ungelected random 


sample. The comparisons were made by a i 
the Kolmogorov-Smirnov test for good ne E ое 
Epstein (1, 2) has suggested this technique as ae 
propriate for testing empirical life testing data a- 
gainst hypothesized curves. Table I summarizes 
the application of the test. 

The maximum absolute difference encountered in 
the test is 0.079. The critical value, using confi- 
dence coefficient of 0. 95, for a sampleof215 cases 
for the Kolmogorov-Smirnov test is 0.093. Since 
the obtained value is smallerthanthe critical value, 
it must be assumed that no difference exists between 
the hypothesized relationships and the obtained em- 
pirical values of the second sample. It follows that 
the administrative decision is that there is no dif- 
ference between the survival datafor those students 
remaining in the given academic program and the 
survival curve generated by application of the early 
failure model to an unselected random sample of 
students. 

The “early failure" model wou ld appear to be 
such that it can be appro priately applied to areas 
other than that for which it was first developed — 
industrial life testing of. component units. In deal- 
ing with college attrition problems, we have found 
it to be applicable, easily computed, and productive 


of meaningful results. 
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THE SAMPLING distribution of the product mo- 
cenit correlation coefficient (r), whenthe population 
р ye (p) is equal to zero, and for any sample 
the (N) was first given by *:Student'' (6). However, 
p sampling distribution of r is asymmetric when 
P #0, and the test of significance developed by 
ax ti becomes less applicable as | p| increas- 
E in value and the distribution of r becomes in- 

reasingly skewed. 
by R. A. Fisher (2) develope 
eec that the sampling distr 
Ver Olic arctangent of r approximate 
n for large values of | pl. 


dan approximate test 
ibution of the hy- 
s normality e- 


z = tanh lr £ = tanh o 
= Ë - 1+p 
z = log it? Е = 5 log | 
2 Ti 2 e|T-p 


s of skewness (8:) 


Fisher derived the coefficient 
distribution of 2: 


aj 
nd kurtosis (8,) for the sampling 


(N-1)° 16 
4 6 
4 2 .5]p - 9 
m 2- 128 12 
Ba = 3 , 32-30% , 128 + Пр =; 


The 16 (N-1) 
of 2 Coefficients, although dependent upon values 
bution d N, tend to approximate the normal distri- 
bun we of zero and three. 
mally Е z transformation is ap. 
istributed about its mean: 


BB. ae) [1] 


proximately nor- 


2 г - 3р 
og £! 4-p2? 22-90 +. 

" Wor U*$ 6D 6(N-1)8 [2] 
hy pP Proxim ations of equations 1 and 2 as given 

и ` David (1) are: 
Завь 2. nj "C [4] 
` on a é N 
formed 


haz 
esea. in was per 
Offi rch reported herein 

fice or Кайеайоп, U. 8. pepartmen 


pursuant 
t of Health, Edu 


A further approximation of equation [1] is 
z-t. [5] 


Equations [1] and [2] are the most accurate ap- 
proximations to the mean and variance of the sam- 
pling distribution of z. Equation [3] provides a 
more accurate approximation ofthe mean of the 
sampling distribution of z than does equation[5]. 
Equations [4] and [5] are the ones commonly used 
in testing the significance of r. 

David (1) reported a study of the efficacy of Fish- 
er's transformation and of the various approx im a- 
tions to it. She showed approximations based on 
formulae [1] and [2] and on formulae [3] and [4] 
yielded probability integrals very close to the actual 
values for p = .9 and N = 11. Similar approxima- 
tions based on values of p = .5 and N = 11 indicated 
that the probability integrals were evencloser to 
actual values for the smaller |p|. For N = 160 and 
pss approximations based on formulae [1] and 
[2] and formulae [3] and [4], both yielded proba- 
bility integrals very close to the actual values; 
approximations based on for mulae [4] and [5] 
yielded probability integrals which deviated from 
actual values by more than.01 for some values of 
r but which were generally very close. 

Harold Hotelling (3) showed that it is impossible 
to have a transformation of r alone whose sampling 
distribution would be normal, having a standard er- 
ror independent ofp. He proposed corrections for 
the mean and variance of z and, in addition, he also 

roposed two modifications of z, suggesting that 
their sampling distributions sould probably be more 
normal, with their standard errors les s dependent 
on values of p and N than that of z. 

The present study was conducted to determine 
how well approximations based on formulae [4] and 
[5] conform to empirically derived sampling distri- 
butions based on samples of size 15, 30, and 90 
were developed for bivariate normalpopulation 
having values of p - .016 and p =. 835. Thiswas I 


to a contract with the Cooperative Research Program 
cation and Welfare. Ç 


JOURNAL OF EXPERIMENTAL EDUCATION 


270 


سڪ = 


6500 ` £800 ` 2620 T@Z0° 06 968" 
$900 ' #00 ` 8820 ITGO ` 0€ G88 ` 
9200 ° 8800 ` 000° #610 ` ST seg’ 
9800 ° 0900 ` 6660" 620° 06 910° 
FS00 ` £800 ' 66@0` 8120" 0$ 910° 
6800 ` T900 ' 8620" sezo’ ST 910° 
HEL cdd — [rep ләмот Пер redd — [rep ләлот " " 


oouvorjgruSIS JO Тәләт IO ` 


eouvoptuSTS Jo [ƏAƏ'1 G0 ` 


NOIO3fH 'IVOLLINO NI SLNSIOIA4300 AANIV LAO AO NOLLHOdOHd 


I TIgV.L 


271 


HJELM - NORRIS 


.07 


.06 


houanhasy 30 qua9 Jaq 


3 3 3 3 à 


00 


98 _ 


Obtained 


ТИНИН ence 


t 


oefficients 
15) 


X» 
| Population (p =+.0] 


02) 
:01 


00 


“of 15,984 


Graph 1 : Distribution 


orrelat io 


Based on Norma 


272 


p 


JOURNAL OF EXPERIMENTAL EDUCATION 


Obtained —— — — 
Theoretical- - – – – Д. 


Жы AE ee а š š š$ $ " 
Graph 2 Distrib GALE de 


LEEEEENER: 
orrelation Coefficients 


on (p=*.016, N-30 ) 


Per cent of Frequency 


HJELM - NORRIS 


Obtained 
Theoretical------ 


Shee cy E 8 
h 3 Distribution of 2,664 Corre 
Based on Normal Population (p**.016. №90) 


$ 8 ¥ x 4 


lation Coefficients 


| бгар 


F 


Per cent of Frequency 


Ë 


273 


274 


JOURNAL OF EXPERIMENTAL EDUCATION 


Obtained ——————— 
Theorelical------ 


Graph ¿ Distribution of 15.984 Correlation Coefficien 
Based on Normal Population (р *835,N-15) 
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ewm of a larger study onthe effects of nonnor- 
i ity on the sampling distributions of the product 
oment correlation coefficients (4). 


Procedures 


ia variate normal populations of size ten thousand 
ed. E ve ves p = .016 and p = . 835 were establish- 
sand bee were punched onto one set of ten thou- 
order m cards which were then placed in random 
Biss y ordering four columns ofrandom digits. 
otf fis ae were obtained by repeatedly counting 
Teorder esired number of cards. The deck was 
random K. by using another set of four columns of 
was тз digits and further samples counted off. This 
the de peated twenty-four times in order to obtain 
> gu men numbers of samples. Sam ples of size 
first бу and 90 were obtained concurrently with the 
Sample o samples of size 15 comprising the first 
Size 39 of size 30, and the first three sam ples of 
Correlatign Prising the first sample of size 90. The 
àmple lon coefficients were calculated for each 
ple elei the sampling distributions for each sam- 
Samplin or each population were tabulated. The 
Cientg 8 distributions consisted of 15, 984 coeffi- 
Samp 9r sample size 15; 7,992 coefficients for 
Size ос Size 30; and 2, 664 coefficients for sam ple 
formed The sampling and calculating were per- 
System by means of the IBM 650 Data Processing 


pa ће Obtained sampling distributions wer e com- 
th leet the theoretical distributions based on 
Smirno [4] and [5] by means of Kolmogorov- 
for p OV goodness-of-fit tests [5]. Critical values 
ч an 005, T, 025, г, 975, and г, 995 were establish- 
Xtra, l'équency tabulations made of the number of 
ч р я Values obtained in each of the em pirical 
distributions. 


r 

üt relies. through 6 compare the obt ained T 
tan olm, арип; distributions. For p-.016, 
20. qepa Borov-Smirnov tests indicated no signifi- 
4 level Te between the two distributions at the 
Whip For к: Significance for samples of size 30 and 
а р, oO jq Ple size 15, the discrepancy Was опе 
bs Went, О©сиг by chance alone between fifteen 
trien t5, Percent of the time. From Table I can 
rients 4: the relative incidence of significant co- 


Sr Yas just about what would be expected. 
nov tests in- 


the obtained 


teq Рал the Kolmogorov-Smir 
ificant departure between 


and theoretical distributions at the . 01 level of sig- 
nificance for samples of size 15 and 30. For sam- 
ples of size 90, the discrepancy was not significant 
at the .20 level. From Table I it can be seen that 
the relative incidence of significant coefficients in 
the lower and upper tails at the .05 and . 01 levels 
did not deviate markedly from the expected for 
sample size 90; however, their inc idence deviated 
more from the expected for sample sizes 15 and 30. 
For sample sizes 15 and 30, the proportions in the 
upper tails were greater than the expected values, 
whereas, the proportions in the lower tails were 
less than the expected values. 


Conclusions 


Results of the present study indicate that the ap- 
proximations to Fisher's transformation given in 
formulae [4] and [5] are quite satisfactory for р = 
. 00 and for samples of size 15, 30 and 90. For p = 
. 83, the approximations to Fisher's transformation 
given by formulae [4] and [5] are less adequate for 
samples of 15 and 30, but become more satisfactory 


for samples of size 90. 
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se TOSE THAT we want to investigate various 
ats llities'' of an essay test. Offhand, this sounds 
at we relational, but closer scrutiny will reveal 
Secure пн a sy stematic experimental design to 
can be he desired answers. Such an ‘‘experiment”’ 
out lima s more and more com plex, virtually with- 
new iei ; each increase іп complexity providing 
ee ights efficiently if the experiment continues 
Ple "wasa well. Let us consider a fairly sim- 
para begin withI individuals, two presumably com- 
grad essays to be written by them, and R readers 
с. the essays. Call the two essays A and B. 
On, a random half of the students write Essay A 
Оер 4 Friday, and Essay B on Monday, and the 
Onda alt write Essay B on Friday and Essay A on 
Ovi Y; this is the familiar counterbalanced, cross- 
qata | Ог switchover design (5). Remove identifying 
уред m the papers (perhaps even having them 
19 not i equalize legibility and attractiveness, if it 
Bather esiredto have these influence grading). Then 
ran the readers together to grade the papers, ar- 
teade, 11 an independent random order for each 


Ju | 
Sach i how should this be done? One way is to give 
“ва S the R readers a random (1/R)th of the (2 x 1) 
Eradin Initially. When all R readers have finished 
2 > re ese in accordance with prescribed stand- 
ы аг ang а140тіле all essays and give each read- 
a Cond idom 2I/R new essays. At the end of the 
ea hang Mind of grading, re-randomize the papers 
r SÑ Gn each reader a random 21/Е new essays. 

“ader “e this for as many rounds as there are 


ontinually draw 


r li 
ng atiy i 
0 ely, ea er might c 
mly » eachread g d complete the 


Bra; 
Adin, гот а роо] оѓ the essays ап 
Quickly as he desired. 


ist; al 
Analysis 
۹ 
еа, Ch St 
eder On Udent will have 2R grades, one from ae 
te Ping qasay A and on Essay В. The SCRE. (o) 


Es ata j à 
s is shown in Table I. 
4 followed by Essay B (A, B) and Essay 


B VE w * (f) are A 
BS s Ssay A (B, A). “Forms alit 
) ang Aqu ences 0 се «form taken first 
Orm taken second’? (2nd). 


Individuals are nested within (do not cross) or- 
ders; a given student writes the two essays in one 
order or the other, not both, so there can be no in- 
teraction of orders with individuals (o x i). 

Also, much complete confounding occurs because 
of the following basic relationships among sums of 
squares for the analysis of variance: o Xf = s, ох 
s =f, and f xs = о. See Stanley (5). 

Let us use Xoirf(s) notationto designate the grade 
received by the ith student (i = 1, 2, . . . , 1/2) in the 
oth order (o = 1, 2)from the rth rater (r = 1,2,. .., R) 
on the fth form (f = 1,2). The sth sequence (s = 1, 
2) for a given individual is determined uniquely by 
the order and form he has, so the subscript s is put 
in parentheses above. Just as properly, one might 
employ Xoirs (f) notation. 

The linear model may be written 


Xoirf(s) = 4 + Xo + 81(0) + Yr + bf + €s + Aor 


+ BYir(o) + Pbit(o) +T Orf + Vers 


+ Brbirt(o) + Woirf(s) › 


where mu is the “general contribution," estimated 
by X...., and the next 11 terms denote the various 
main effects and interactions. Woirf(s) is the ran- 
dom error of measurement in Xoirf(s), which could 
be estimated if reader r graded each essay more 
than once. Assumptions about components of the 
linear model are essentially those given by Cornfielq 
and Tukey (1:920-21). 

The Iexaminees are assumed to have been drawn 
randomly from a large (perhaps hypothetical) popu- 
lation of examinees, andthe R readers are assumed 
to have been drawn randomly from a large (perhaps 


hypothetical) population of readers.. Thus Bi(o) and 
з are random effects, and sothey do not, in general 
h 


sum to zero unless the summation is taken over all 
i's, or all r's, in the respective populations. Spe. 
cifically, 


E #0, and š 
x В; y and 2 [xy Z 0 
#21 i(o) mat 252 


Order, form, and sequence are fixed effects so 


the following relationships hold: a 
А,В + в. A= 
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TABLE I 


ARRANGEMENT OF GRADES GIVEN TO I EXAMINEES BY R READERS ON 
FORMS A AND B OF AN ESSAY TEST ` 


1 2 Pu R 
Order Individual 
(o) (i) A B A B ee A B ee A B 
1 lst*  2nd* 1st 2nd soos 1st 2nd ghi 1st 2nd 
2 1st 2nd 1st 2nd — 1st 2nd any 1st 2nd 
A,B ` 
iA, B** Ist 2nd 1st 2nd ven 1st 2nd T 1st 2nd 
1/2 1st 2nd 1st 2nd Meis 1st 2nd — ist 2nd 
1/2+1 2nd 1st 2nd 1st — 2nd Ist та 2па 1st 
1/2 + 2 2па 1st 2nd lst eed 2nd 1st КР, 2па 1st 
B, A 
М2 + iB, A 2nd Ist 2nd Ist TT 2nd 1st T 2nd 1st 
I 2nd 1st 2nd 1st — 2nd 1st — 2nd 1st 


* Individual 1 and all other examinees with the order À, B took Form A first (1st) and Form B sec- 
ond (2nd). In Table II, form taken first versus form taken second constitutes what is called ‘‘se- 
quence” there; s = 1, 2. 

**The ith examinee in Order A, B. 
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zero; 6A + 6B = zero; and € {st + €2nd = zero. Sim- 
ilarly, for example, 


2 

E {vor = CTA, Bsr + CYB, A;r = 0, but 
o= 

R 

EX oy #0 

n=1 


Table II shows sources of variation, degrees of 
freedom, and average (‘‘expected’’) values of mean 
squares for this design. There are 11 orthogonal 
sources of variation, but only i, r, and (i x r) are 
unconfounded. The other eight sources are com- 
pletely confounded, each with one other source, be- 
cause of the ‘‘telescoping’’ of forms and sequences 
into a single dimension. 

Six different sums of squares involve readers 
(r), and therefore grades can be adjusted for five 
possibly significant sources of reader bias (all but 
i xr Xx f) by reducing the magnitude of the mean 
Squares for r, oXr, iXr,r Xf, andr X s via sta- 
tistical methods Stanley (3:213) has described. 

From Table II one may devise appropriate mean 
Squares for testing the significance of the five main 
effects and the five first-order interactions (but only 
approximately for i х r) via procedures explained by 
Stanley (6:834-35) for a somewhat different design. 

How highly dothe two forms correlate? This can 
be estimated (4) for 

R R 
ZXoir£g With ZXoirf' via Tof of' = 


[MSiqp + MSig, ~ М(х) дв - MS(ix f) pA] / 


[MSi 5 B MSi BA + MS(ixf)ap + M$(ixt)g Al (1) 


= [MSi - M$á x $)] /[ MSi + Му], 


where f 2 f', and of, of! = ОА, 0B and ов, oA. 
Are the two forms measuring exactly the same 
thing? Stanley (3) has shown that they are not if 


Ft - 2), ü - 2)(R - 1)] = MSG x f) ч 
MS(j x r x f) 


is significant. Reducing the magnitude of MS(i xf) 
to that of MS(j x r x f) will render the forms more 
nearly comparable and increase rof of". 
How well do the readers (r) agree, оп the aver- 
age? The correlation of 
2 2 
E Xoirf with et 


can be estimated (4) by 


Tor,or' ^ [ MS; - MS( x г)! Î MSi + 


(3) 
(R - 1)MS(j rl; 


where r Z r', and the bar denotes the mean for all 
values of r,r'. 

What is the mean ‘‘reliability’’ coefficient when 
Essay A is graded byagiven reader and Essay B by 
the same reader? Compute (3, formulas 7 and 5) 


————— М8} + (Е - 1)MS(i xr) - MS(i xf) 
Torf orf" = с = : MS); 
MS; + (R 1)MS(ix r) * (i xf) 


- (R - DMS(ixr xf) (4) 
+ (R - 1)MS(i x r xf) 
where f,f' = A, B and B, A; call the denominator d. 


What is the average agreement among readers of 
the same form? (Compute 3, formulas 6 and 5) 


Torf, or'f = [MSi - MS(ixr) + MS(i xf) 
= MSáx px t)) /d, (5) 


where r Z r' and f =f (i.e., А = A, В = В). ul 
Cureton (2) suggests that the appropriate де 
bility coefficient for anessay test is the correlati? 
between one reader's grades on one form and al 
other reader's grades on a com parable form. 
estimate this, compute (3, formulas 8 and 5) 


Torf, or'f' = [ MSi - MS(ixr) - MS(ix f) 


6 
*MS(i x y x t)] /d. (6) 


— . than 
Typically, rorf,or'f' will be smaller tha 
Torf, orf! and Torf, орт. 


If MS(jxf) Significantly exceeds MS(i xr xf 
may obtain an estimate of the correlation betW 58 
truly comparable forms scored by different eae 
by reducing the magnitude of Meu to Lam 
MS(i xr xf) statistically (3, formula 3) and com P 


]- 
" А TA E 
ing an adjusted, larger value of rorf,or'f' as fo 


js one 


lows: (1) 
za ee. Mi- Mixi , 
Torfa,or'f'g = a 
a, o a MSi+(R- T)MS(ixr) + RMS(i xr XP 
ake 
where the subscript a's denote adjustments to ma 
MS(i xf) = MS(ix r xf). 
Measurement and Experimentation 
at 


h 

Perhaps the above outline suffices to show ‘ost 
even the administration and grading of essay ig? 
can profitably involve Fisherian principles of are? 
and analysis. Analysis-of-variance mean Se er^ 
readily enableusto estimate various average ce 
correlations, freed from several possible $0". ine 
of heterogeneity. These r's help us understa™ „rd 
analysis-of-variance results better and point t° то? 
adjustments of grades to free them statistically com^ 
reader biases and to make them more nearly 


STANLEY 


parable fr Г 
from form to form. Thus measurement and 3 


experi i 
larly oe complement each other, particu- 
n repeated measurements occur. 


REFERENCES 


l. Cornfi 
um Jerome, and Tukey, John. ‘‘Average 
M crier da Squares in Factorials, `` An- 
а athematica atisti | 
- ноп atical Statistics, XXVII (1956), 
- Cur 
ur Edward E. “The Definition and Esti- 
ation of Test Reliability, " Educational and 


Psychological Measurement, XVIII (1958 


Pp. 715-38. 


283 


Stanley, Julian C. “ 
; . “Analysis of Unrepli 
сощы Classifications, with D s 
: ater Bias and Trait Independence " Pay. 
chometrika, XXVI (1961), pp. 205-19. Au 
Stanley, Julian C. “K-R 20 as the Step ed 
eum Item Intercorrelation,"" 14th р 
0 the National Council оп Measurement i gE 
ucation (1957), pp. 78-92 MER 
Stanley, JulianC. ‘‘Statisti à 
ley, 1 atistical Analysi Г 
ШП aes Tests," нық pv 
rimental Educati | ) Е 
=. cation, XXIII (1955), рр. 187- 
Stanley, Julian C. "Analysis of a Doubly Nest- 
ed Design, Educational and Psychological 


Measurement, XXI (1961), pp. 831-37 


A SIMPLE TEST FOR SKEWNESS IN 
SMOOTH UNIMODAL DISTRIBUTIONS 


JOHN OLIVER COOK 
North Carolina State College 


SINCE IN ALL symmetrical unimodal distributions the mean, me- 
e way to define a skewed, unimodal distri- 


dian, and mode coincide, on 
bution is to say that it is not symme 
we compute deviation scores 

tribution is distinguished by the 
the left of the mode wi 
of the mode. The question o 
is significantly skewed is thus re 


mean of the deviations 


the mean of the deviations to thi 
score 


trical about the mode. 
from the mode, a skewed, unimodal dis- 
fact that the mean of the deviations to 
11 not equal the mean 0 
f whether a smooth unimodal distribution 
duced to the question of whether the 
to the left of the mode differs significantly from 


e right of the mode. 
s will themselves be skewed, we can, 


That is, if 


f the deviations to the right 


Since both of the 


distributions of deviation 
thing like the Mann-Whitney U Test to com- 


conservatively, use some 

pare the two distributions. 
If the distribution curve i 

no great peril involved in ignoring m 


the distribution is irregular to the ex 
scores, then per 


s not smooth, 
inor irregularities. 
tent thatthetrue mode is isolated 
haps this method for evaluating 


it can be seen that there is 
However, if 


from the bulk of the 
had better not be used. 


degree of skewness 
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di ege MANY of you a restatement of the problems 
ап accomplishment quotient (AQ) willbe a redun- 
Bron However, inrecently reviewing a number of 
vious ie for research in education, it became ob- 
ате Б at the statistical lessons of the 20's and 30's 
Seen a forgotten or never learned by many. That 
visor н this: Any time a variable is used as a di- 
likely another variable the resulting quotient is 
Which eects negatively withoutside variables 
divisor, inarily are positively correlated with the 
g ed much research in education, the data 
Statistic: will inadvertently back himself into this 
Which Sd trap. The most publicized quotient for 
Quotient 11188 are issued is the accomplishment 
results ; It is here that the most obviously spurious 
ally nays obtained because anything which is usu- 
Sore nes ‘good’ in a school system tends to 
перац е negatively with the AQ. Some of these 
erg: sale related variables include higher teach- 
deg, e aries, percent ofteachers with Master’s 
bue per-pupil expenditures, etc. : 

Cationa] or» there are other quotients used in edu- 
the o research which can cause trouble. One of 
Variabls common, of course, is the IQ. Againa 
о olo Mental Age, is divided by a variable, 
Ive yo el Age. Often the IQ correlates nega- 
Erade eee age of the student evenwithin a given 


€ ni 2 
NO closely related problem is the concept of 
Br Varian “under” achievement, alt hough here 
e i ates are simply subtracted from one anoth- 
én Беле Of being divided. When this is done with- 
om Non it of a regression equation, the same phe- 
to d as described above takes place. The variable 
the, а subtrahend tends to be negatively related 
sult of the subtraction and this result will 
to be negatively correlated with variables 
Tnarily would be positively correlated with 


ral 
sha hy ie variable. 


——— — — _ 
= X a _— 


? It will be 
will be expected to 


Ro late ul © with all variables that pos 
«PF 
Or ex, Degatively related to IQ scores: 


‚ ха, 
j feine y le, if the AQ is use 


Of a class or school in 


STATISTICAL PROBLEMS OF THE 
ACCOMPLISHMENT QUOTIENT 


WILLIAM ASHER 
University of Pittsburgh 


must be recognized that in the majority of the cas- 
es, the classes or schools withhighIQ students will 
probably have AQ's of less than 100 or be ''ineffi- 
cient." Alternately, a class or School with below- 
average IQ's will generally be “efficient or tend 
to have AQ's above 100. Not only will this happen, 
but all the variables and attributes normally posi- 
tively associated with high IQ populations in our so- 
ciety, such as higher teachers'salaries, higher per 
pupil expenditures, number of teachers with ad- 
vanced degrees, higher family income, number of 
books in the home, social economic status of the 
children's family etc., will generally be expected to 
be negatively correlated to the AQ scores. 

Why should this occur ? Several very able men 
(2, 3, 6) have contributed to our knowledge. Douglass 
and Huffaker (3) seem to have been the first to show 
the algebraic proof, although the geometrical proof 
was presented earlier by Toops and Symonds (6). 

Douglass and Huffaker took the formula for the 
correlation between two ratios, ah presented by 

yw 
Holzinger (5), and derived the equation for the spe- 
cial case of the correlation of a variable, x, witha 
ratio, when the denominator of the ratio is the var- 
iable x. The notation for this is Е 2m 3n 
1x x 

Let us look at the equations: From Holzinger (5) 
we have the formula for the correlation between two 
ratios (see top of next page), where rxz is the cor- 
relation between the variables X and Z, Vx = ох, etc. 
(This last term, Vx, is the almost tongottem саев. 
cient of variation. ) 

Douglass and Huffaker (3) show that ryz ,the cor - 

x 


relation of a variable with a ratio, the denominator 
of which is the variable, is as follows: 


rxz Vz - Vx 


tga = 35 HRONERUO 
x / VÉ = 2095 Vg Vg VE 


By assuming that Ox = 02 andthat X = Z, we сап каг 
duce the above equation to: 


rxz- 1 


IZ = Tan ج‎ 
х2 © 2(0 - rxz) 


Replacing EQ by X andIQ by Y in the AQ formula 
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rxz Vx Vz+ ryw Vy Vw - rxw Vx Vw - ryz Vy Vz 


TS V (Vx - 2rxy Vx Vy + Vy)(Vz - 2rzw Vz Vw + Vw) 


and substituting in the above formula we find, fol- 
lowing Douglass and Huffaker, 


TIQ,EQ -1 
r E = агаа 
юле. 20 - rio. gg) 


To determine the possible range of the correla- 
tion coefficient, assume that гт EQ could assume 
all the possible correlational values from +1. 00 to 
-1.00, and let us determine what values can be ob- 
tained for the correlation between the IQ score and 
the AQ ratio. 


"IQ, EQ "IS, PS 
41.00 . 00 
+ .50 - .50 

. 00 = т 
- .50 -.75 
-1.00 -1.00 


It is obvious that the correlation between the IQ 
and the AQ can assume only zeroor negative values. 
No positive values can be obtained. 

Cureton (2) developed a regression accomplish- 
ment quotient, RAQ, which in effect partials out this 
relationship by the use of b coefficients computed 
from the actual correlations between the test of 
mental ability and the testof academic achievement. 
His equation is: 


EA 


RAQ - ч š 
bea, maMA(Kea - bea, ma Xma) 


This RAQ has an ex pected value of 100 for the 
sample from which the regression was computed, 
whether the average IQ of the group is high or low. 
Obviously, this was an advance in statistical tech- 
nique. In addition, Cureton developed the equations 
for computing the sampling errors of the RAQ and 
by using actual data showed the ways in which they 
could be used. 

At this point, perhaps, a new relationship can be 
shown. The above paragraphs deal with the AQ de- 
fined as AQ = EQ/IQ. A variation of the AQ defini- 
tion which is slightly different inits implications for 
the conclusions is AQ = EA/MA. Seemingly, since 
EQ = EA/CA, IQ = MA/CA, and AQ = EQ/IQ, the 
AQ equals EA/CA/MA/CA (or multiplying through 
by CA, EA/MA). The simple quotient value is cer- 
tainly the same, but the relationship to a third var- 
iable is somewhat different. 

Let us examine the more general case of a cor- 
relation between a variable and the ratio of two oth- 
er variables, the form Fxg We again go to Hol- 


zinger (5): 


—— rxzVz - rxwVw 
xa VVE - бган: Ууз Vw 


Assuming means and standard deviations equal, 


rxzV - rxwV 


" LoIxzV - rxwV ___ 
"Ao VW Dray + V° 


V(rxz - rxw) 


J2V? - 2rzwV? 


V(rxz - rxw) 


Vv 2(1 - rzw) 
2 аЗ 
ҮІ - rzw) 
er 
Note that here as usual the denominator can Pu 
be negative. The sign of the correlation r к 
or- 
usual is taken from the numerator. If rxz, MC 


relation of the variable in the numerator of tl i 
tio with the undivided variable, is greater than ou 
the correlation of the variable in the denomina e 
then the correlation will be positive. Ifthe rev 

is true, then the correlation will be negative. (hen 


If X - W, as is the special case in rüqES, 


IQ ji 

; | & 
TIQ,IQ İS +1. 00 апа r(x) must be negative ех , 
(хф 


for the special case where X = W = Z, where * 
is zero. ables 
Now, if the AQ is defined by the pios inet 22 
EA/MA, and substituting for simplification yel 
and MA = W, the AQ thus defined must be пева, pe 
related only with МА. Itwill tend, of course: nd, 
negatively related to positive correlates of 
of course, one of these is IQ. ates of 
The above cited general case of the corre 
ratios is, of course, not limited to the p^ regard 
indicated, a fairly common problem is with А 
to the IQ. two var 
Anytime a quotient is obtained from s ela 
ables, it must be recognized that an unus E 
tionship exists between the variable in ав. Th 
nator of the quotient and outside variab E ally 
relationship will be the reverse of that ee at a 
expected between them unless the correlati 5 jab 
variable in the numerator with the outside V = 
is greater than it is with the denominator. . ecil 
Sometimes researchers are aware of the 


le AQ problem and the more general quotient of two 
variables problems. Yet they may still feel that 
there is “over” or “under” achievement of some 
type based on the predictions of another variable, 
Usually a test score of some type. They hypothesize 
that Johnny is not doing as wellas he might be **ex- 
pected" to do on, say, reading. They base their 
rele Hon on some test which correlates well with 
of t ing. Many researchers have cleared the hurdle 
he AQ fallacy, sothey no longer divide one score 
d о ШЕЮ, They have become sophisticated enough 
ees à regression line of Y on X, find the differ- 
tok S between the plotted scores of Johnny and his 
m Orts, and use thesedifferencesas a criterion for 
rther work, 
here is not a methodo logical objection to the 
ve procedure, but there is need to recognize that 
A seh mig could be handled entirely analytically 
ugh the use of multiple or partial correlations. 
Scan ne correlate highly with Y (but there is much 
“ "ingly unexplained variance—‘‘under’’ and 


abo 
the 


thr 


Over? ` л 
able L. achievement), simply adding another vari- 
mu © the prediction equation with the use of the 


не correlation technique will quickly indicate 
signifi the simple correlation coefficient can be 
aroun, Cantly increased. Jf it is the deviation scores 
Can be og ErSsion line which are desired, these 
“uation, tained through the use of the regression 
Probe general approach of the quotient technique to 
Vigoro ems in education has been the object of some 
the ca "S objections, Obviously this should be so in 
Si ‘le of the simple AQ. What is puzzling is that 
the © AQ has survived so long. Even granting that 
Som Q technique should be used, there are still 
tation ifficult problems encountered in its interpre- 
are hy Three good discussions of these problems 
d indi Cureton (2), and Flanagan (4). 
Cate lcate generally as follows: The RAQ can in- 


: However 
quen а the development of general intelligence. 
дола а Problem of independently measuring educa- 
tan just levement and intelligence must be faced. 
tes What test scores do you wishto summate to 
ш education? The problem has become even 
Dr tipi т Plex in recent years with the advent of 
sip ble actor intelligence tests. At one time the 
to ble. 9f how to arrive at an MA or IQ was rather 
Breqic OW what isthe best combination of Жеш» 
laj "the What school achievement ‘“‘should’’ Бе ' 
le, 581 Problem is that the AQ is not highly re- 
telk the м, € errors of measurement and sampling of 
(gy tity ™ erator and denominator affect it. ү 
2). У Coefficient has been cited to be abou 


e 
àge pf the students increase, problems 
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arise in relation to growth curves. Various aspects 
of the intelligence may mature more rapidly than 
others, and achievement becomes more differen- 
tiated. The assumption that these functions should 
be related after a certain age may be in error. 

In summary then, it must be concluded that the 
use of the simple AQ, whether defined as EQ/IQ or 
EA/MA, willlikely lead to erroneous conclusions 
about the relationship of simple AQ to the IQ or MA 
because of the distinct possibility that a negative cor- 
relation will result. These erroneous conclusions 
are also likely to extend to all variables positively 
correlated with either the IQ or MA. 

The RAQ will make corrections to accomodate 
for this negative relationship. Methods to compute 
the sampling error of this RAQ have been developed. 

The more general solution of the correlation of a 
third variable to the quotient of two variables was de- 
rived. It is shown that the relative size of the simple 
correlations between the third variable and the nu- 
merator and the denominator will determine whether 
the correlation between the ratio and the third vari- 
able will be positive or negative. If the denominator 
variable-third variable relationship is algebraically 
greater than the numerator-third variable relation- 
ship, then the quotient-third variable correlation 
must be negative, and vice versa. 

Methodological approaches to simpler analytical 
solutions of problems involving ‘“under’’ and **over'' 
achievement were discussed. 

Finally, some problems of interpretation of even 
the RAQ were discussed and references for further 
reading presented. 
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CONJUNCTIVE-DISJUNCTIVE-IMPLICATIONAL 
MODEL IN DISCRETE SCALES 


MAGOROH MARUYAMA 
University of California, Berkeley 


ae ARTIC LE is an ap plication of sentential 
erns = on inductive data. Giventhe response pat- 
tests th a number of individuals on a num ber of 
inferential wees to obtain inductively the relative 
Шон; Strength of the tests intheir conjunctive- 
tia] P tl combinations, and the relative inferen- 
шде of the individuals in their conjunctive- 
js Fide combinations is discussed. 
Structeg ег shown that this model, though con- 
tive qi ‘in a framework different from the conjunc- 
be оов Sive model by Coombs and Kao (1), can 
Set these With the latter to form a factor -space 
7 leationsy This model also exten ds into the im- 
Jun ive al relationships between multi-variate con- 
9f the 7-disjunctive conditions the conceptualization 
Work by Francis (8). 
Sent per is divided into two parts: the first part 
Part 8 the theory of the model, andthe second 
sents the computational measures. 


The 
Theory of the Model 


Su 

e at роза We are confronted with the data tabulat- 
are bottom of the page. We immediately notice 
4م‎ i ag Edward have a same response pattern, 
a nse ; Donald and Mary have another identical 
'Bht qia, Pattern. Therefore, altogether there are 
Nex Stinet response patterns (topof next column). 
en р V? try to discover some relationships be- 

dache and/or absence of good appetite, and 


he 


(hh (+,+,-,-,-) (mtt) (+,-,-,+,+) 
Gast Ж) (b em) (ы) (тт) 
oysters, warm blanket and/or cold cabin. We may 
make several hypotheses. One possible hypothesis 
might be that cold cabin implies headache, or its 
equivalent, that absence of headache implies that 
one has not slept ina cold cabin. Let us denote 
“p implies Q" by “P ->Q”’. Let us also use the 
following abbreviations: 
: ate oysters 

had warm blankets 
cabin was cold 
has headache 
has good appetite 

~: negation sign 
Then the hypothesis can be written as C -->H or 
its logical equivalent ~H --» 2C. Wealsoknow that 
both forms are equivalent to~(C and~H). In other 
words, if the bypothesis is correct, then there 
should be no subject whose cabin was cold and who 
has no headache. In fact, if we tabulate the number 
of subjects for the four possible response patterns 
(+, +), (+,-), (+), (=, =) for the two tests C and H, 
we find that there are no subjects for (+, -). There- 
fore the hypothesis is supported. Note that the hy- 
pothesis requires only that headache canbe inferred 
from having slept in a cold cabin and that not having 
slept in a cold cabin can be inferred from the ab- 
sence of headache as long as these eleven subjects 


CHOU 


had warm cabin has has good 
Subject р blankets was cold headache appetite 
"RR 
Tudy Yes Yes Yes oe No 
Edward Yes Yes Yes ig 
George Yes Yes po Yes No 
Nancy Yes No ig Yes Yes 
Ralph Yes No No Yes Y 
Anita No Yes Yes LR Ed 
Donald No Yes Yes es es 
Mary No Yes xes E n 
William No ves c Yos = 
Barbara No No No No 


Robert No 
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No | non-0 
No Yes P 
Q 
Yes 


No | non-0 


Yes | non-0 


No 


(H and~G) 


Yes 


No 


George 
Ralph 


William 
Robert 
No 


No 


поп-0 0 P-->~Q 


поп-0 Q -->~P 


Yes P 


non-0 | ~P -->Q 


No 0 non-0 | ~Q --> P 


Barbara |4C -->~(H and~G) 


are concerned. The hypothesis does not propose a causal re- 
lationship. It proposes a logical inferrability, or in other 
words, implicational relationship. The hypothesis is support- 
ed by the fact that the number of sugjects for («,-)is 0. The 
hypothesis is confirmed by the fact thatthe numbers of the sub- 
jects for (+,+) and for (-, -) are non-zero, and the number for 
(+,-) is 0. The number for (-, +) is irrelevant for the hypoth- 
esis: If the number for (-,+) were zero, then we have two-way 
implications, i.e., C -->H and H -->C 
~H-->~C and wC -->~H . 

The two-way implicational relationship is called “logical €” 
equivalence" which we denote by “<->”. Le.,(P <-->Q) for 
((P -->Q)and (Q --> P)). ion- 

If we want to distinguish the one-way implicational relatio! 2 
ship from the two-way implicational relationship, we С all th 
former the ‘‘proper’”’ implicational relationship. A proper rA 
plicational relationship holds if and only if one and only one of m 
four cells of the 2 by 2 table is empty. The direction oft 
implication is summarized at the left. en 

Next, let us examine the implicational relationship betw® ra 
two terms, one or both of which may consist of several tore 
combined by conjunctions and/or disjunctions. For exam p H 
let us examine the implicational relationship between C and 
and~G), where (H and~G) is Yes if and only if H is Yes an 
is No. 

As tabulated at the left, we find that (H and ~G) --7 
Compare this with the previous result C -->H. It is remat 
able that C implied H whereasC is implied by (H and~G). 1. à 
by adding~G to H, we reversed the direction of the implic" 
tional relationship. H 

Let us examine a few more examples. When we tabulate 


. Да 
against (A or ~B), we find that there is по implicational геле. 


> Ther 
abulat- 


or~B). In general, by adding to one or both sides a new ert 
or its negation by conjunction or disjunction, one may gra 
reverse or abolish implicational relationships. ¿an ction: 
Another example: Let us add C to (A or ~B) by conjunto c) 
and tabulate this against H. Then we obtain: ((A or —B) ear 
--2H. Whereas we previously had (A or ~B) XH. ЕЧ rtg. 
more, we can also show that : ((A or~B) and C) —->(H aT re" 
To summarize the changes of the direction of implication” | jn 
lationships with the addition of anew test on one of the side 


Anita the foregoing e : 
oan going examples: 
Mary C 
Yes C--^H (A or ~B) XH 
C <- (H and~G) ((A or B) and C) —>H 


м. z (A or~B) — (H and~G) 


((A or ~B) and C) <--> (H шыка” 
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Deductive Strength and Inductive Stre ngth of Rela- 
tionships 
د‎ 


sdb and only if a relationship f is logically infer- 
{бай from another relationship 4 but ¥ is not log- 
aes from B, we вау ару is deductive- 
A. ronger than f. We express this by ' 20”. 
n ntm (P --» Q) is deductively stronger than 
See € R) -->Q). If y and f are relationships, we 
Per (% --> 9) is equivalent to (y > p). 
asil e foliowing relative deductive strength can 
(P z be seen: " А 
(p PH) -->Q) 2 (p -->Q) Z (P and R) -->Q) 
(p < 4 and 5)) > (P --> Q) 2 (P --> (Q or 5)) 
> 270 Q 3 (P -->9) 
(OS Q ЭЖ(р-&— 9) 
Apa) апа (g 20) --> ( 29) 
(A ae these, we see that : 
(cB) and С) <-> (H and ~G)) > 
(Ао --(H and ~G)) 
(ca gD) and C) <-> (Н and~G)) > 
((А о ТВ) and C) --> H) _ 
(A ~B) апа C) <--> (H and~G)) > 
In oth or~ B) «--(H and ~G)) 
(с < Words, the transition from the relationship 
the на (н and~G)), whichwas obtained by tabulating 
tionshin > on C, H and G of the data, to the rela- 
Vas dB (((A or ~B) and C) <--> (H and ~G)), which 
Additis àined by tabulating the scores on A and B in 
Sliding to the scores on C, H and G. I.e., by in- 
опер? More data into analysis, we obtained а rela- 
holag Р Which is deductively stronger. The same 
L^ н) үсү for the transitionfrom (((A or~B) апа С) 
for the 10 (CA or~ B) and C) <-> (H and~G)), and 
a б transition from ((A or ~B) <-- (Н and~G)) to 
p, 9n then and C) <--> (Н and ~G)). " 
Тош (c Other hand, let us examine the transition 
` > Н) to (C <- (Hand~G)). There is no 
nferrability either from the first to the sec- 
rom the second to the first. Inthis case, 
e E more data did not result inthe increase 
t e. Ctive strength of the relationship obtain- 
Оперу Might feel, however, that the second rela- 
18 in some way stronger than the first re- 
Cont Se " Since it is based on more data. In a 
`w Maing 15 is true, since the second relations hip 
Some amount of information r eg arding G 


he 
ti, “Pea, 3 
З the first relationship contains no informa- 


lon 
(н. Te 3 а 
А ang SAT ding G. But we have to realize that in 
tially lost: 


L 
an Š PL the information on H is par 
NQ Ot ayy Wing the truth value of (Hand~G), we 
an) is WAYS infer the truth value of H. If (H and 
№90) £5» We know that H must be Yes. But if (H 
by unless NO, we do not know whether H is Yes or 
We know the truth value of G. Therefore, 
аа ) he transition from (C --> Н) to (C &- 
» We gained some information regarding 
5 ы some information regarding H, though 
hip, 10ге information in calculating the rela- 


ing 
of asio 


But if it happens that Ø retains more information 
on all its components than y does, we say that Ø is 
inductively stronger than y, and we express this by 
(@ 2). 

To summarize: If the relationship f is obtained 
from a larger body of data than the relationship J, 
either one, both, or none of the following relation- 
ships hold. (This is tautological, but the point is 
that we can distinguish thefour cases; only the first 
one holds; only the second one holds; neither holds; 
both hold.) 05у 790 


Discovery of Equivalence Relationships Through 
Implicational Relationships 


Suppose there is a type of bacteria called M. M 
causes a disease which is determin ed by a set of 
symptoms. Let us further assumethat M is the on- 
ly bacteria which causesthis paiticular set of symp- 
toms. For example, M causes (headache and loss 
of appetite), and no other bacteria cause this par- 
ticular combination of symptoms. Furthermore, 
M, and only M, develops under aspecific set of 
conditions in the human body. Let us say that this 
set of conditions is ((having eaten oysters or had no 
warm blankets) and slept in a cold cabin). Then 
there should be a one-to-one corre s pondence be- 
tween the presence or absence of this set of condi- 
tions and the presence or absence of this set of 
symptoms: ((A or ~B) and С) <--> (H and ~G). Fur- 
thermore, let us assume that there are other types 
of bacteria which, respectively, cause: only head- 
ache, headache and skin irritation, headache and 
loss of appetite and loss of hair, etc. Let us also 
assume that these other types of bacteria develop 
under their specific set of conditions which might 
include the patient's having eaten oysters, etc. 

Suppose further that we have not yet discovered 
M, we do not know exactly what symptoms are 
caused by M, we do not know w hether one type of 
bacteria can cause both headache and loss of appe- 
tite, we do not know yet exactly what set of condi- 
tions is related to headache and/or loss of appetite 
etc., and we are given only a table similar to the 
one on page 1, including larger numbers of symp- 
toms, conditions and subjects. Then, suppose that 
by playing with the table, we discovered the rela- 
tionship ((А or~B) and C) <-> (Н and ~G). Then 
we may hypothesize that there may be atype of bac- 
teria which cause (H and ~G) and which develop un- 
der the condition ((A or ~B) and C), and proceed to 
undertake some bacteriological ex periments ac- 
cordingly. 

Our question here is: In what way do we pla 
with the table in order to discover any zelali ki 
at all? And the ultimate relationship we want to дс 
rive is an equivalence relationship. This isthe sit- 
uation in many sociological and psyc ho logical is 
searches. For example, take a study on the cau = 
of alcoholism. One does not know what combin 
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tions of circumstances are conduciveto alcoholism. 
One does not know that given a same combination of 
circumstances, among what other alternativesa 
person chooses drinking. One does not know what 
other symptoms do or do not occur regularly with 
alcoholism, etc. One gathers data andtries to find 
what conjunctive-disjunctive combinations of cir- 
cumstances are necessary and sufficient conditions 
for a conjunctive-disjunctive set of behavior, in- 
cluding alcoholism. 

A direction of reasoning, whichseems natural to 
the human brain in this case, is to tabulate first a 
simple combination against another simple combi- 
nation, and then proceed to more complex combina- 
tions. 

If P,, Pz... Pp are separately a necessary con- 
dition for Q, then their conjunction is also a neces- 
sary condition for Q. 

((P, <-Q) and (P; «--Q)... (Pn <-9)) <-> 
((P, and P, ... Pn) &--Q) 

For example, if cold weather is a necessary 
condition for influenza, andoverworkingis a neces- 
sary condition for influenza, then (cold weather and 
overworking) is a necessary condition for influenza. 
The next natural question is whether (cold weather 
and overworking) is a sufficient condition for influ- 
enza. I. e., can we attain a necessary and suffi- 
cient condition by making a conjunction of neces- 
sary conditions ? 

If the necessary and sufficient condition had a 
conjunctive structure, i.e., if 

(P, and P, ... Pn) <-> Q, then 

(P, <-Q) and P; &-Q).... (Pn <-9) 
and by making a conjunction of all P,’s, one obtains 
a necessary and sufficient condition. Butthe ne- 
cessary and sufficient condition may be attained be- 
fore all the necessary conditions are added up, with 


some P;'s missing. Inthat case, the P 1.5 not 
needed are called spprious necessary co nditions 
with respect to the needed Pj’s. Spuriousness may 
be relative: if one adds one or more spurious ne- 
cessary conditions to the conjunction, some ot her 
necessary conditions, which were not spurious, may 
now become spurious. 

If Ø is the conjunction of needed necessary con- 
ditions to make the conjunctiona necessary and suf- 
ficient condition, and if ф is the conjunction of the 
spurious necessary conditions with respect to б, 
then there is the following relationship between 
and: ñ --> № 1 

If, on the other hand, the necessary and suffi- 
cient condition has a disjunctive structure: 

(P, or Pa ... P.) <->Q, then 

(P, -->Q) and (P; -->Q)... (Py -->Q) : 
Inthis case, one may attain a necessary and suffi- 
cient condition by making a disjunction of sufficient 
conditions. For example, Pj’s are various conta- 
gious diseases and Q is hospitalization in a conta- 
gious disease hospital. Each contagious disease iS 
a sufficient condition for hospitalization inthis hos- 
pital, but one has to have at least one contageous 
disease in order to be admitted to this hospita” 
Again there may be sufficient conditions which ar 
not needed to make the disjunction a necessary an 
sufficient condition, for example, some diseas 
which always involves another disease. Such con" 
ditions are called spurious sufficient condit ion? 
with respect to the needed sufficient conditions. 

9 is the disjunction of the needed sufficient condi- 
tions to make the disjunction a necessary and suffi 

cient condition, and if Y is the disjunction of SPY?" 
lous sufficient conditions with respect to f 
there is the following relationship between Й and di 


— 
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Next, suppose we have the following tabulations from the data: 


Yes| 0 P<-R P is a necessary condition for R, and Q is a necessary condi- 
No [60 | 12] tionfor R. The question naturally arises asto whether (P and 
No Yes Q) is a necessary and sufficient conditionfor R. Do the numbers 

P in the tabulation give any clue? In order to investigate this 

let us imagine a three-dimentional tabulation. The numbers 

R Yes[ 0 [ 28] Q —-R in the two-dimentionaltabulations now become marginal sums. 
Let the vertical dimension be the dimension of R, and let the 


No [30] 42] 

top floor be R - Yes, and the bottom floor be R - No. Let us 
map the top floor in a two-dimensional tabulation , of whichthe 
marginals are known. From the marginals, we conclude that 
the only non-empty cell is the one for Р = Yes and Q - Yes. 


R 
ры, Since for the top floor R= Yes, we conclude that if Ris Yes, 


8 P and Q has to be Yes; (P and Q) <- R. Next, we want to ex- 

49 Q Ø amine whether „(Р and Q) <-- ~R by mapping the bottom floor. 

Q Q g p If (P and Q) &- ~R, then by logical equiv alence we obtain 
[eo] (P and Q) -->R. 

We want to see whether the cell for P - Yes and Q - Yes on 

The numbers indicate the bottom floor can be shown to be empty. But since there is 

marginal sums one degree of freedom in the choice of the rumbers in the cells 

on the bottom floor, the cell for P - Yes and Q - Yes cannot 

be proved to be empty. Therefore, ~(P and Q) S- -R cannot 

> R cannot be established. In 


the following two-dimentional tabulations have be en made be- 
tween P and S, and between Q апа S. Then the three-dimen- 


60 12 tional tabulation has the marginalsas indicated. Let the top 
Q Yes 4 bottom floor floor be S = Yes, and the bottom floor be S = No. 
R = No 
No 30 Yes 42 [40 | Yes 
S [70 | 
S wo [18 T 0 | No 


So P Yes No Yes No Yes 
P Q 
P -->S Q -->s 


0 28 be established, and (P and Q) -- 
Yes top floor order to find whether the cell for P - Yes and Q - Yes on the 
Q R = Yes bottom floor is empty, we have to go back to the raw data, The 
No 0 situation to determine whether the disjunction of sufficient con- 
о еѕ ditions becomes a necessary condition is analogous. Suppose 
P 


dimensional marginals on the bottom floor make 


Then the two- 
No and Q = No the only non-empty cell on this 


the cell for P - š 
Hence (~P and~Q) <—- <S, i.e., (Р or Q) -->S. Butwe 


loor. 
"ee. = to find whether (P or Q) ©- S, or its logical equivalent 
А < > ~(~P and~Q) <- 5. I. e., we want to find whether the cellfor 
18 P = No and Q = No on the top floorisempty. Butbecause there 
(0 is one degree of freedom in determining the numbers in the 
Th cells on the top floor, the emptiness of the cell for P = No ang 
© numbers indicate Q = No cannot be concluded from the knowledge of the margin- 
Marginal sums al sums. The raw data have to be consulted, 
Effect of the Associations among the Necessary Conditions ang 
Q Yes 42| 40 Sufficient Conditions 
No 70 top floor junctive-disjuncti 
Rb qus One advantage of conjunctive-disjunctive analysis is that it 
а ein Hineover relat ionships which can hardly be uncovered b: 
es of association, correlation, etc. $ 


o Yes 
most of the measur s 
(P and Q) is a necessary and sufficient condi 


P 
Assume that 5 25 
Q Yes 18 0 bottom floor tion for R. If P and Q are highly positively correlated or as- 
No S = No sociated, then Pand R are also highly positively correlateq 
x 18 d Q and R are also highly positively correlated 
o 
P 


associated, an 
Yes or associated with eachother. But whenP and Qare not highly 
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iti i tionships between 
Yes | 49 | 1 | positively correlated or associated, the relati 1 d 
" No | 1 | 49 | P and R, and between Q and R, cannot be easily discovere 
No Yes without implicational analysis. | rated. 
P As an example, let P and Q be highly negatively assocl ne 
And given (P and Q)<--> R, we obtain the following tabula 
between P and R, and between Q and R. t do not 
0 F| R 0 1 Yule’s Q, Y, etc. will give the value of +1, x ПЫР 
B Es p 9 50 | 49 distinguish between (P <--> К), (P -->R) and (P <-R); 
between (Q <-> R), (Q --> R) and (Q <- R). йз аё 
The correlation coefficient computed as if the four m 1) 18 
P<-R Q<-R concentrated on the four points (0,0), (0,1), (1,0), ( Lee 
+0.1005. (The values of other measures are given E ros ЛЫ 
of this paper.) And given (P or 9) <--> 5, the situa E of 
S s[ 49] 50 | similar: A few other exam ples for various m eps 
1 0 1 0 and Q are given below. Where (P and Q) <=> R, le endol 
P Q <-> $, the values of various measures are given at the 
this paper. 
P-->S Q -->S 
P vs. Q P vs. R Qvs. R P vs. S Q vs. S 
0] 49 0] 49 49 07 51 2 9 
49| 2| [49| 2| [31] 9 
33 | 34 0 34 3 33 67 33 67 
0| 33| [33 | 33 33 | 33 0| 0 0| O 
0] 34] [ 0] 34] m p 0] 67 33 [3 
33 33 33 6 0 33 0 ШЕЕ 0 
18 | 42 0 [22 0 2 18 T 70] 28 | 60 
12 28 30 | 28 [40 |1 12] Ü 12 0 
25 | 25] LOI | [0] 25 25 | 50 25 [50 
[50 | 5| [50-175] [25 T 9] 


At the end of this paper, various measures of association 
are discussed and compared, and some new measures are pro- 
posed which are suited for implicational analysis. 


Inferential Strength of Tests 


ationship C --> H canbe read as ‘‘no mat- 
Werl if he has slept ina cold cabin, 
then he has a headache". Here we are dealing with 
a logical inference, not causality. To emphasize 
this point, let us give another example: е (H and 
~G) can be read as “no matter which individual, if 
he has a headache and has no good appetite, thenhe 
must have slept in a cold cabin". If P -->Q, we 
say that P is inferentially stronger thanQ. C is 
inferentially stronger than H, but weaker than (H 
апа ~G). E (P --» Q) and (Q --> R), then (P --> R). 
This is called transitivity of the implicational rela- 
tionship. We may also abbreviate (P cep Q) and 
(Q --» R)) into (P --2Q --2 R) This is not to be 
confused with ((P -->Q) -->R) or with (P --> (Q 


p 7 (Hand-G)--»C -->H. The inferen- 


epicul” 
tial strength of tests also parallels withthe a] as 
ty of the tests, if passing inthe tests 15 De «no 
Yes. For example: T, --» T, can be read asse? 
matter who, if he passes Test T,, then he Шап est 
Test T2”, i.e., Test T, is more difficult as Test 
T2, and Test T, is inferentially stronger ien uals: 
Т» with respect to the competence of the Laine the 
Certain cautions are necessary in interpret ^? and 
inferential strength. For example, quem, b on 
Т») --> T, --» T,, one might be tem pte T an! 
clude that, since T, is more difficult than о, 8, 
(T, and Ta) is more difficult than Тз, Тг m is 10 
more difficult than Тз. But this conclusion Т „ай 
justified. The above form is exactly the 5..7 
(H and ~G) -->C --» Н. One might expect ag 
C. But going back to our original table on P di 
we find that ~G XC. | а eati; 

Concretely interpreted, both singing a nandi" 

spaghetti, separately, may be easier than 
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vd. leg. But singing and eating spaghetti at the 
i e time may prove to be more difficult than 
anding on one leg. 


Symmetry Between Tests and Individuals 


T re of recording the response pattern of an 
Siem ot on all tests, we may recordthe response 
returni of a test on all individuals. For example, 
sponse ng to the initial data on page 1, the “re- 

e5 E aic of having eaten oysters is (Yes, 

eine es, Yes, Yes, No, No, No, No, No, No) on 
and DM oes individuals. We remember that Edward 

onald y had a same response pattern, and Anita, 
ern, os Mary had another same response pat- 
Tespons et us treat the individuals having a same 
eight ty e pattern as one type. Then we have only 
Oysters to The response pattern of having eaten 
No, No wr eight types is (Yes, Yes, Yes, Yes, 
Individual о, No). We interpreted Yes to mean one 
response passing atest. When we talk about the 
response of a test to an individual rather than the 
is reve of the individual to the test, the situation 
“Test ipee Thus, “Jim passed Test T" becomes 
Of a test failed Jim". Therefore, for the response 
irectio to individual types, we want to reverse the 
Cations n of passing and failing. Withthese modifi- 
tests t the table of the response patterns of the 

9 the individual types now becomes: 


Judy 
Edward George Nancy 


ate oysters ” - 


had Warm blankets s 


cabi 
bin was cold - + 
ha, 

S headache - + 


h 
а5 good appetite 


strength parallels the competence 
s г 1 . Thus the model 
is symmetrical with respect totests and individuals. 


The Relationship Between the Conjunctive-Disjunc- 
tive Model by Coombs and Kao and our Present 
Model 


The model by Coombs and Kao (1) is designed 
for nonmetric factor analysis. Given data, which 
are scores, categorized into “pass” and ‘‘fail’’ 
on a number of individuals on a num ber of tests, 
one hypothesizes that underlying the tests (or indi- 
viduals) there are factors, that the threshold of the 
tests (or individuals)is conjunctive or disjunctive 
of certain levels of the factors. The analyzer 
makes an ad hoc choice between the two alterna- 
tives: all the tests (or individuals) are conjunctive 
with respect to the factors; or all the tests (or indi- 
viduals) are disjunctive with respect to the factors. 
By examining the response patterns, the analyzer 
obtains the number of factors. Let us say that this 
number is n. The tests (or individuals) are then 
rank-ordered n-dimensionally in the factor space. 


There is a symmetry between the tests and the in- 
dividuals: one may analyze the response patterns of 
the individuals representing succ ess or failure on 
the tests, or one may analyze theresponse pat- 
terns of the tests representing not being conquered 


Anita 
Donald 
Ralph Mary William Barbara Robert 

* + + + 
- - + + 
- + - + 
e + E + 
= + + + 


We ñ 
tabulate Judy against George, we obtain: 


Geo 
"e +T 
а Judy --> George 


+ 


This Judy 
wies g Be re ich test, if it 
бы S Jug, A as “по matter whic uh ue 
a 


Qe ds, ¿ Y» then it passes Georg © 


0 š 
Bas 8e tar. matter what test, if Judy fails it, then 
St, Stn Sit ie, , Judy is more competent in 


is inferentially 
metime Judy is 
nferential 


ор. te 

Moy Ber the, than George is. Judy 

Compet George, and at the 5а 
ent than George. The i 


or being conquered by the individuals. Inthe first 
case, one factor-analyzes the tests. In the second 
case, one factor-analyzes the individuals. 

Whereas the model by Coombs and Kao factor- 
analyzes the tests (or the individuals), our present 
model examines the inferrability (Logical inferra- 
bility, which may or may not be causal relationshi 
between tests (or individuals) or between sets el 
conjunctive-disjunctive combinations of tests (o 
individuals). This model does not rank -order d 
tests (or individuals) n-dimensionally in the fact е 
space, but investigates the relative infer enisi 
strength between the tests (or individuals) or 2 
tween sets of conjunctive-disjunctive idit ione 
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of tests (or individuals). There is a parallelism 
between the inferential strength and the difficulty of 
the tests (or the competence of the individuals). 
Though there are certain devices to approach an e- 
quivalent relationship (a necessary and sufficient 
condition), for example, by making a conjunction of 
necessary conditions or bym ak ing a disjunction of 
sufficient conditions, the choice of the conjunctive- 
disjunctive combinations ofthetests (or individuals) 
as well as the choice as to which tests (or individu- 
als) to start with, is largely left to the judgment of 
the analyzer, and is improved mostly by trial and 
error. There is a symmetry between the tests and 
the individuals: one may analyze the response pat- 
tern of the individuals representing success or fail- 
ureon the tests, or one may analyze the response 
pattern of the tests representing notbeing conquer- 
ed or being conquered by individuals. In the first 
case, we obtain the relative inferential strength of 
the tests. In the sceond case, we obtain the rela- 
tive inferential strength of the individuals. 

A question which arises naturally is: Cannot 
both models be combined? Isthere any relationship 
between the position in the factor Space and the in- 
ferential strength? The answer is Yes. In fact , 
our present model сап ре combined with models 
much more general than the one by Coombs and Kao 
It can be combined with models based onfactor 
Spaces, regardless of whether they are conjunctive, 
disjunctive, compensatory, curvilinear or multiple 
closed (N - 1)-dimensional surfaces, as long as for 
each test (or individual) the factor space is divided 
into mutually disjoint but jointly exhaustive connect- 
ed or unconnected regions of Yes's and No's, i.e. 


each point in the space is either Yes or No, but not 
both. 


(A and ~B) 


(~A and~B) | (B and ~A) 


Let us illustrate this with afew examples. Take 
a conjunctive model of a two-dimentional X 
Space. Test A requires X, of Factor X, and Ya 9 
Y. Then the space is divided into two regions by -A 
L-shaped boundary with the apex at (X,, Ya) an 
with the two arms extending to the positive аш 
tions of X апа Y. Individuals on the uppe ке righ 
side of this boundary pass Test A, and individuals 
on the lower and/or left side of the boundary e 
Test A. Therefore, let us denote the upper-righ 
region by (A), and the lower-left region by eee 
Test B requires Xj, of Factor X, and Yp of qe 
Y, we do the same and obtain regions (B) and (~ (A 
Then the intersection of (A) and (B), denoted by ih 
and B), is the region for individuals passing bo 
Test A and Test B. Theintersection of (A) pm 
(~B), denoted by (A and ~B), is the region for Le 
individuals passing Test A but failing Test B. з 
апа В) апа (~A апа ~B) сап be defined similar P 
(A or B) is the union of (A) and (B), and is the ^ 
gion for individuals passing Test A or passing E 
B. (A or B) is obtained by joining together (A a 
B), (A and~B) and (~A and B). Similarly d ч 
(~A or B) and (~A or ~B) can be defined. It pis 
happen that some of these conj unctive-disjunct' 
regions are empty. For example, in the case ey 
Xa <Xp and at the same time Ya < Yb, there rest 
be no individual who passes Test B and fails t 
A. In this case (~A and B) is an empty region. 
us denote an empty region by (0). 


Si, [ae ست‎ (A and B) 


B! (A and ~B) 


8 
ael 
The same principle can be extended to ma 15 
other than conjunctive. For example, if Ie d if 
compensatory in Factor X and Factor Y, ? 


4 


(C and D) 


(^C and <D) 


(C and ~D) 


E 
(~E and F) 


(C and D) 


D 
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Test D is disjunctive in Factor X and Factor Y, and if their 
boundaries intersect. then we have the situation shown at the 
left of the page. first figure from the top. Let ustake a 
more general case. Test E has a boundary which consists of 
two disjoint closed simple curves, and the insides of the curves 
are the regions for individuals passing Test E. In other words 
(E) consists of two separate regions. Test F is conjunctive 
with respect to X and ~Y. In other words, inorder to pass 
Test F, the individual has to be above Xy on dimension X, and 
below Yr on dimension Y. 

So far we have defined the formation of regions by conjunc- 
tive and disjunctive combinations of two tests. For cases for 
more than two tests, the definition applies recursively. Now 
let us define the inferential strength in the factor space. Let 
us take a case where (P) is included in (Q). Let us denote this 
inclusion relationship by (P) <: (Q). This means that the re- 
gion for individuals passing Test P isincluded in the region for 
individuals passing Test Q. That is, no matter which individ- 
ual, if he passes Test P, then he passes Test Q. This is pre- 
cisely P --> Q; i.e., P is inferentially stronger than Q, or in 
other words, P is more difficult than Q. Now the relationship 
between the inferential strength and the factor space is clear: 
(P) <: (Q) is logically equivalent to P --> Q. The same is 
true when we replace P and Q with Ø andy, respectively, 
which are conjunctive-disjunctive combinations of tests or in- 
dividuals: (Ø <: ф) is logically equivalent to @--> Фф. Let us 
add the following notations: **(P) :> (Q)" for **(P) includes (Q)’’, 
and **(P) :3 : (Q)"' for “neither (P) nor (Q)includes the other’? 

Then we have (P) :> (Q) is logically equivalent to P <-- Q. 
(P) :38: (Q) is logically equivalent to P :: Q. Anempty set 
(0) can be interpreted to be included in any non-empty set (Z). 
Therefore, if O isa non-existing relationship, we have (0) <: 
(Z) and 0 --> 2. | | <a 

Thus we have established a link between the conjunctive- 
tive-compensatory model by Coombs and Kao and our 
present conjunctive-disjunctive-implicational model by means 
of logical equivalence between the set-theoretical includion re- 
lationship in Coombs-Kao’s factor space and our inferential 
strength relationship. This is not to say that both models are 
isomorphic: The difference be tween the two models is that 
Coombs-Kao’s model is for the discovery of the structure of 
the factor space, and our present model is for the determina- 
tion of inferential structure, which is the includion relation- 
ship in the factor space, but which can be obtained without the 

i factor space. 

ee vA also dent that the inferential structure applies to 
models more general than Coombs-Kao's model. This sug- 
gests that when Coombs-Kao’s model will have been more 
generalized and a more general model of factor Space is ob- 
tained, our inferential model combines with it to build agen- 
eral factor space set theory or factor space topology. The i- 
dea may well be applied to metric (continuous-scale) spaces 
as my previous papers < Lex and Colex> , < Rectifiabil ity of 
Bivariate Distribution > and < Locating the Ap ex in the Con- 
junctive-Disjunctive Model» indicate its beginning (2). The 
factor space set theory or factor space topology then provides 
a basis for implicational statistics whic h is based on logical 
inferential relationships, and which is not bound by the as- 
sumptions of normal distribution, homoscedascity and corre. 

niques on which the contemporary factor-analytic 


A hi 
lational tec The implicational statistics will therefore 


ies are built. : : 
Ce restricted by the compliance to the normality of distri- 


disjunc 
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Positive Association 


bution, homoscedascity, etc. 

This present paper is only to indicate the beginning of such 
a theory of factor-space set theory or topology, and of implica- 
tional statistics. Ideas from the readers are appreciated. 

Before closing this paper, let us make a comparison of Sev- 
eral measures of association, asymmetry, etc. , applied on 
data expressed in n-rows by m-columns table. Our prese nt 
comparison will be limited to two dimensional two by two table 
data. 


Computational Comparison of Various Parameters for TWO by 
Two Table Data 


As Goodman and Kruskal (3) have pointed out, one may ш 
vertantly introduce spurious associational relationships 1n rae 
m table by the way one constructs the categorizations of 
subjects into disjoint classes, or by the way one ae a a 
cutting points on continuous scales in order to convert Sue nr 
into discrete scales. For example, given a bivariate distri ing 
tion as shown here, with a very low cor relation, by choon y 
the cutting points at the medians of both dimensions, one m 
obtain a two by two table. On the other hand, by enon e 
cutting points away from the medians, one may obtain 2 ta 


| .25 [.25] Bum 
[25 | .25 | [.2 |-8 | 


Or, when the bivariate distribution is as shown on t! 
the association may be positive or negative, depending on 
cutting points. lation 

The choice of the cutting points thus influences the rela e to 
ships shown in an n by m table, We may therefore deci ase: 
choose the cutting points always at the medians. In this table: 
since there is only one degree of freedom іп atwo by tWO ** 
the table is symmetrical with respect to both diagonals. ` n, We 

In case we have data on dichotomous scales to start Wit» 
have no choice but to accept the dichotomous scales. pu 

Our problem here is not how to dichotomize the scale?» yo 
to compare the values of various parameters once atw0 
table has been given. 


he left; 
the 


Various Measures 
eee NOY 


Y:Yes | c 
¥:No [—d 
X:No X:Yes 2 


š 2 enc?) 
Chi square: X = Z (observed frequency - expected fred 


expected frequency. wher 
‚ 1 we define the expectedfrequency to be N: pi jP2j'; the it 
N is the total number of cases, pı; is the probability ОГ f sjon? 


class along the first dimension regardless of other dim eî yer” 
Рә] is the probability of the j-th class along the secon c 
sions regardless of other dimensions...and where the dim"; 
question is the intersection of the i-th class inthe first » 
Sion, the j-th class in the second dimension..., in саве ch 
dimensions with two classes eachas in our case, t” 
square reduces to the formula: 5 
x° =  (a+b+c+d) (ad-bc) 

a+b) (c+d) (a+c) (b+d 

Delta: (4, p. 310) ad - bc 
N 


5 = 
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Yule's Q: (5) (coefficient of association) 
Q = ad - bc 
ad « bc 


Yule's ү; (5) (coefficient of colligation) 
= Vad - be 


ad + vbc 


V: (4, p. 311) 


y= ad - be 


Mean Square contingency: (3, p. 739) 
MSQC = x?/N 


P ‚ 
*arson’s С (3, p. 739) 
PC = 


T 

Schuprow's T: (3, p. 740) © 
T= У(ХЁ/М)/ ү түш 1) for n by m table. 
In our case, n B 2 di m - 2. 


Hence T - VxTZN 


ming mër (6, p. 282) suggests a measure (X /N)/ 
this ту m-1). In our case, since n = 2 and m = 2, 
aboye Ces to mean square contingency mentioned 


Qvi S and Pq are defined as follows. Given two 

3 Sa fas taken at random and independently. Let 

Q^ the [Pt the first individual falls in the i-th class 

Q Ө dimension and j-th class on the a 

tis eae the second individual falls in the i-th 
°з СО the first dimension and in the j*th class on 
8 is (174 dimension. An 

b Ë). Probability that (ic i' and j<j';or i>i and 

15 


Tha the " 
phe thre Pobability that (i = i’; or j = j”) > 

€s а 38es corresponding to the three prob- 
s Mutually exclusive and jointly exhaus- 


tive. Hence Ps + Pq + Pi = 1. 

In the two by two case, i <i’ and j <j’ if and only 
if the response pattern of the first individual is 
(-,-) and the response pattern of the second individ- 
ual is (+, +). The probability is therefore d. a 

N N 

Similarly, we can tabulate the condition, the re- 
sponse patterns of the two individuals and the prob- 
ability in the manner shown at the bottom of the page. 

Hence, P, = 2ad/N^ , Pd -2bc/N? 

And because min (n, m) = 2, we obtain 

te = 4(ad - bc) /N? 


Goodman-Kruskal's gamma (3, p. 749) isdefined as 


+= Ps Pa 


1 - P. 
But for two byt two table, , 
Pg- Ра 2(ad- Ьс)/М ad- be 


1 -P ` 2(ad + bc)/N^ ad + be 


Goodman-Kruskal’s Lambda: (3, p. 743) 


= fim * = fmj - Í. m 7 fm. 
xs d j 
2N - (fm + fm.) where 
fim - max (fil, fis. TE Ímj - max (flj fj... ṣi 
fam -max (Efi; Yin) Ím. 


- z > A 
=max (Gij Pfoj . iol) 


and f;; is the frequency entered at the intersection 
of the i-th class on the first dimension and the j-th 


class on the second dimension. 
For two by two case, the equation at the bottom 


е, 
б з ИА Correlation coefficient is computed 
as if all the subjects withthe response pattern (-, -) 
are located at the coordinate (0,0),t he subjects 
with the response pattern (-,+) at the coordinate 
(0,1), the subjects with the re sponse pattern (+, -) 
at the coordinate (1,0), andthe subjects with the 
response pattern (+, +) at the coordinate (1,1). Thus 
NZXY - (ZX) (LY) 
becomes 


Txy ^ № ox oy 


Probability 
Condition Response Patterns 
i y lasa) ad/N* 
i? a <i? -.-) (4,+ 2 
К cat] Ds 
igi en (o) (=) nr 
jou and j <j" й. ii Y (=) (dc + cd + ba + ab) /N^ 
isir JS) 2-609 G- 
ын о) Gb @›-) пе 
Т P (5 639 (9 
ELS (+,-) XE ol ae (d? + c2 + b? + a?) /N? 
land j =j' ae ЖА! NM 


X 


, max (b,d)) - max (a+c, b«d) - max (a+b, c+d) 


= + ,с) 
ч (max(a, b) + max(c, d) e tss bid) + max (a+b, c+d)) 


2N - ( 
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aN - (а+Ы)(а+с) _-ad-be (This is equal to the V on the last page.) 
N? c, с a+b) (c+d) (a+c) (b«d 
£ y 
because 


f (a+b) (c+ d) 


1 
ex == NEX - EX = N (arb) = (ab)? = š 
1 1 
N 


oy =i NEY - (хү)? = / (ase) (b+d) 


eS xy N (a+c) - (a+c)? = 


Lex and colex: (2) Lex and colex are measures of asymmetry along the two diagonals, and were defined, aS 
the correlation coefficient, for bivariate distributions on continuous scales. 

lex (x, y) = 220011). солех (x, y) =2N2(I PI .Q) 
ам - (ZI Q|) AN? - (=| P| )° 
X-X ye IY 

X оу 

For two by two discrete cases, lex and colex are computed as if the response patterns (=, =), (-,+), (+s 2), 
(+,+) are located at the coordinates (0, 0), (0,1), (1,0), (1,1) respectively. 


where P=U-V, Q-U-V, U= 


Maruyama's E: (proposed in this paper) As we saw on the first page of this paper, an im pl icational Hm. 
tionship is established in a two by two table when one of the cells is empty and its vertical -neighbor cel n 
horizontal-neighbor cell are not empty (whether the fourth cell is empty or nonempty is irrelevant). FO 
ample, when b is 0 and a and d are non-zero, we have X--» Y and ~Y --»—X. This is because the cond 
probability for Y = Yes when X = Yes is 1, and the conditional probability for X = No when Y = No is 1. 

We want to define a measure which indicates the degree of inferrability even when the two condition 
abilities are not both 1. We propose: 


T crai 
ition? 


al prob" 


E. = 


1 
ys (DX; + рү} ) where 


Ш 


, ,ACP (YZj /X = i) - EP (Y É j) 
U^ ACP (Y Z j /X = i) + EP (Y £ j) - 2: ACP (Y É j/X = i) EP (Y Z j) 


DX 


ур = ACP (X Z VY = j) - EP (X Z i) 
J ACP (x 4i/¥ = j) + EP (X 4 i) - 2: ACP (X Z i/Y = j) ‘EP (X Z i) 


age +1 ile 
ACP (U/V) means the actual conditional probability of U when V is given. EP (U) means the expected proba’ ) 


ity of U regardless of V. For example, ACP (Y = Yes/X = Yes) = a/ (a+b), and EP (Y = Yes) = (a«c)/ (a*b** 
The function Dia ACP - EP has the following property: D = 0 when ACP = EP 
ACP + EP - 2: ACP- EP D =1 when ACP = 1 


D = -1 when ACP = 0 


The function was found in the following way: We want a function f(x) which satisfies the following condition? 
š $ 18 

f(x) = 0 when x =k, where К is a given constant, 0 < k <1 (k is neither 0 or 1, because no marginal sum | 

f(x) 1 when x =1 , 

f(x) = -1 when x = 0 

-1 < f(x) <1 when 0<x<1 f(x) is a monotonic continuous function of x. 

Such a function is not uniquely determined. We choose one sim ion: = (тх + 

: ple type of function: f(x) = (px + q) 

The value of p, q, r and s can be obtained from the three values of the niinus specified at three va. ue nÓ c 

Without loss of generality, we let р = 1 (by dividing both the numerator and the denominator by p): 9 7 e 

can be solved from the three equations. We obtain e X-k In order to show that f(x) is on 

-2k)x + 
and continuous for 0< x < 1, we show that f’ exists in this interval and 0 <I f'| <œ, and is continuous: 
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Ae (xy = (A= 2k) x + E) - (x - I) (1 - 28) _ 2 (к-к?) 
((1 - 2k) x + k) ((1 - 2k) x + k)? 


Since the numerator is a poritive constant (because 0 <k <1), it suffices to show that the denominator is 
continuous and does not vanish. For this, it suffices to show that ((1 - 2k) x + k) is continuous and does not 
on Since it is a linear polynomial of x, it is continuous. To show that (1 - 2k)x + k # 0 is to show that x Z 
< (2k - 1) except when k = 0.5. When К = 0. 5, (1 -2k)x +k = 0.5 40. When k # 0.5, let y = k/(2k -1) If 0 

k <0. 5, then y <0. Hence y # x (because 0<х<1). For 0.5 <k <1, we have 


3 к L.(k-1-2k.  -l <0 Hence for 0.5<k <1, _ К sim | E -1 
dk 2k-1  (2k-1)? (2k- 1)? тер 1. ERCY 


Hence y >1, and therefore y # х. Therefore (1 - 2k) x + k does not vanish for 0 < x <1 and 0 Ck <1. 


Hence f(x) = x-k satisfies our desired conditions. Substituting D for f(x), ACP for x and EP for k, 


(I - 2k)x +k 


We obra; 
° obtain p _ ACP - EP 
ACP + EP - 2. ACP. EP 


; Ei is a measure of the emptiness of the cell Cjj. If Cj; is as empty as expected from the marginal sums, 


iS zero i hile its vertical neighbor cell and horizontal neighbor cell are non- 
e - If C; is completely empty while its v ° 
g. ty, Bij is: 1 dr Cij is Fonz ore while its vertical neighbor cell and horizontal neighbor cell are empty, 
lj is .1 g 
Furthermore, we obtain the following relationship: Pj 
в, 


ij = 


=0. This can be proved as follows: 


((DX11 + DY11) + (DX12 + DY12) + (DX21 + DY) + (DX22 + DY99)) = 


(охуу + DX 19) + (DX21 + DX22) + (DY11 + DY21) + (DY12 + DY22)) 
Dx + ACP(Y, /X,) - EP(Y;) 
1 1/243 2 

"защ ASQ) i EO -5 ACPUY;/XipEP(Yi ACP(Y, /X,) + ЕР(Ү,) - 2 ACP(Y, /X,): ЕР(Ү,) 

2 1 

il 


шш arithmetic computations) 0. Similarly, DX21 + DX22 = 0, DY11 + DY21 = 0, DY12 + DY22 = 0. 


Yme 
a> Cosymemp: These two measures 
Ong the diagonals. Symemp = E21 - E12; 


‘gn is given as follows: 
8, ; ЕТ 4. symemp апа cosymemp is g | 
NT = ( ЕРШЕ: А vada rete) E APGI) - 2- EP(Cij AP(Cjj)) where EP(Cij) is the expected proba- 
raty for hole AP(Ci) 1J the actual probability for the cell Cjj, andare defined: AP(Cij) = fiy N, 
ij 1 i m ;. = vfu ss Shey = Pete: 
Cy =. f. е: ' fij is the observed frequency in the cell Cjj, fi ш fj zu d тү 


are derived from E. They indicate the degree of symmetry of E 
Cosymemp = E22 - E11. 


mh | ij 1 dd up to 0 
ji у j .. which add up to 0, Gij do not always add up to 0. 
Syme а Simpler measure than Ejj, but unlike Ejj whic p j 

3n 21 - Gg, cosymg = G22 - G11: 


? COs metry of the two sides separated by the diagonals. 


Sy Уша: These are simpler measures of asym ` (are) - (ibê) 
ma. (e/(a+c+d)) - (b/(a+b+d)) cosyma = re E LEED) 


Ë (cZ(are+d)) + (b/(a« b«d)) 


"s i ai 
Ying 5*1 when b is 0, and -1 when c 1$ 0. Cosym 


Syn, УШЫ: a variation of syma and cosyma- 
= (SZ (азуу) - (b/(a+c+d)) 
Sy, | 89099) + (Ь/(а+с+®) 


Is 41 When b is 0. and -1 when c is 0. Cosymb is + 


s +1 when a is 0 and -] when d is 0. 


_ (d/(a+b+e)) - (a/(b+e+d)) 
© (d/(a«b«c)) + (a/(b+c+d)) 


cosymb 


1 when a is 0, and -1 when d is 0. 
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The Four Major Types of Parameters 


The parameters mentioned above can be divided 
into four major types. 

Type 1: individual cell type. The parameters of 
this type indicate the degree of discrepancy between 
the actual frequency and the expected frequency for 
each of the four cells. In this type we have Е}} апа 
and Gij which both indicate for each cell the degree 
of emptiness in relation to its expected emptiness: 
they are 0 when the actual probability for the cell is 
equal to the expected probability; +1 when the actual 
probability is 0, and -1 when the actual probability 
is +1 (This statement needs some qialification in the 
case of Ejj. The meaning should be understood in 
the light of the definition of Eij. k 

Type 2: diagonal line-asymmetry type. The ta- 
ble is divided into two parts by a diagonal line, and 
the two parts are compared as totheir relative 
emptiness. If both sides are equally empty, the 
parameters are zero; if they are not, the parame- 
ters take values positive or negative, depending on 


TYPE 1 PARAMETERS 


Cny|Cvy E Gn 

Cnn|Cyn] Enn|Eyn| Gnn [Gyn 
1 ka 0000 0000 0000 0000 
25 0000 0000 0000 000 
2 l 0 6000 -. 6000 5000 -. 3333 
40[10| -.6000 .6000 -.3333  .5000 
3 45[ 5 -. 8000 8000 -.4211 7273 
[ 5[45] 8000 -.8000 7273 -.4211 
4 [20] 60 | 0000 0000 . 0000 0000 
5/15 | 0000 0000 . 0000 0000 
5 33133 3200 -. 6044 2209 -. 2599 
33| 1 =. 6044 8889 -.2599 8565 


š 0051 -.5025 .0026 -.0051 
T -.5025 1.0000 -.0051 1.0000 
Z[49] .9245 -.9623 8903 -. 4851 

8 a9] 0| -.9623 1.0000 -.4851 1.0000 
1740 -.5051 0100 -.0100 

TIO] -.6689 1.0000 -.3356 1.0000 
[ OT8O] 1.0000 -1.0000 1.0000 -. 3846 
10 бб] 0] -1.0000 1.0000 -.7132 1.0000 
7107 -. 7125 6359 -. 2942 

du SE -.9179 . 8597 -.6819 7734 
[2T3] -.9300 .5782 -.8629 2447 
12 тр 7184 -.3666 4877 -. 1433 
(96, 3 0103 -, 5026 0039 -. 0052 
13PT[ 9] -.5077 1.0000 -.0154 1.0000 
[TOE] 6567 - 6667 3333 -.2016 
147770] -.9900 1.0000 9612 1.0000 
5 BE 0000 .0000 .0000  .0000 
[5| $] 0000 0000 0000 —.0000 


which side is more empty than the other. Since 
there are two diagonals, each of these parameters 
has two versions: one when the diagonal is the m 
diagonal, i. e. , the diagonal running through Cii; û 
one when the diagonal is the co-diagonal, i. €., x 
diagonal perpendicular to the main diagonal. ThE 
parameter for the latter case is called the co- par 
ameter of the parameter for the former case. 
have five pairs of parameters inthis type: lex ап" 
colex; symemp and cosymemp; symg and co sy mg: 
syma and cosyma; symb and cosymb. ters 
Type 3: diagonal-product type. The parame on 
in this type are derived from comparisons betw s 
the two diagonal products ad and be. In this (Ур 
we have Delta, Yule's Q and Y, V (which is equa 
correlation), and Stuart's tau-c. chi- 
Type 4: overall unevenness type. We have 206. 
square, mean square contingency, Pear sO a 
Tschuprow's T and Goodman-Kruskal's Lamb Р: 
In the final three pages, we compare the ac Ho 
values of the parameters for 15 give n two ne 
tables, and discuss their usefulness as indic a 
of implicational relationships. 


and 


Discussion on Type 1 Parameters 


n 

Ingeneral Gj; has a higher absolute value Pus 
Ejj- An important difference between E hen " 
is observed in case 10. Е, and E : is 
whereas Gpn is -0. 7143 and Gyy 1720. 3846. 75i 
is because Gj; depends directly on fj, where? 
depends only indirectly on fjj. sae -1 

[m is the frequency in the cell Cjj where 
and j£ j). j 

As we saw on the first page of this arti 
implicational relationship is established о! 
by two table when one of the cells is empty an cell 
vertical-neighbor cell and horizontal-neighbor “j 
are nonempty. In this consideration, it İS P mp 
evant whether the fourth cell is empty or pee cast 
ty. Since Ejj is unaffected by fjj in cases], rim 
10, Ejj is more appropriate as à measure ^ E 
plicational relationship than Gij- Further," 
14, if we compare f y with fyn and шу 
garding fnn, Суу is Very nonempty. | 
therefore want a parameter togive a hig 
value for C For this reason, we see 
is more appropriate than Gj; in Case 1% 
fore we prefer Ejj to Gij as а measure of пір" 
ness for the purpose of implicational relatio 


cle, an 
na two 


4 * 


A 
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TYPE 2 PARAMETERS 


lex , symemp 
colex cosymemp 
1 25| 25 0000 0000 
25| 25 0000 0000 
2 10] 40 0000 0000 
[40] 10] 0000 0000 
3 45| 5 0000 0000 
[ 5| 45 0000 0000 
meura 0859 0000 
1 -. 6869 . 0000 


©з] сој 

©з 
E 
- 
о 
о 
о 
о 
о 
о 
~ 
со 
[27] 


<J 
= 
m 
m 
e 
° 
° 
° 
© 
© 
e 
e 
о 
о 
rs 
о 
о 
о 
о 
о 


a 2129] 1. 0000 0755 
[39] 0j] 0000 0000 

g[49[50] _.7o99 8260 
[1] 0} -. 6839 1639 


symg syma symb 
cosymg cosyma cosymb 
0000 0000 0000 
0000 . 0000 0000 
0000 0000 0000 
0000 . 0000 0000 
0000 . 0000 0000 
0000 . 0000 0000 
0000 1130 1724 
0000 -. 6696 -.9322 
6357 9143 9598 
0000 . 0000 0000 
7748 1. 0000 1. 0000 
0000 . 0000 0000 
9974 1. 0000 1. 0000 
0000 0000 0000 
097 1. 0000 1. 0000 
0000 0000 0000 
9900 1. 0000 1. 0000 
3256 -. 9238 -. 9800 
0000 . 0000 0000 
3297 . 0000 -. 8824 
1374 3241 3425 
3877 -. 1309 =. 9104 
7196 -. 4842 -. 9974 
-. 2430 -. 4923 -. 5076 
9961 1. 0000 1. 0000 
0102 -. 4923 -. 5076 
6667 1. 0000 1. 0000 
7595 -. 3288 -. 9996 
0000 6780 8791 
0000 -. 6780 -. 8791 


di 
8 
| Ussion 5 
It n Type 2 parameters 


| 


lt can 
tee hay, Observed that as a whole, symg and e 
tag Men, higher absolute values than symemp ан 
vas 5 If the table is line-symmetrical a Р 


ess of опе с 
а апа cosyma, 
uenced by figs 


8 › 6, 
Pray pres and 8, the emptin 
and co ed by lex and colex, Sym 
Symb, which are not inf 


whereas symemp and cosymemp, symg and cosymg 
are influenced by fj. 

Case 10 distinguishes symg-cosymg and symb- 
cosymb from other parameters. In Cases 13and14 
syma-cosyma and symb-cosymb indicate the empti- 
ness of a cell better than other parameters, ln os 
15, in which the actual frequencies are same as 3 
pected frequencies but the table is not di eme 3 
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TYPE 3 AND TYPE 4 PARAMETERS 


Type 3 Type 4 
Q Y V(r) Chi-Square MSQC 
Tau-c Delta С a T Lambda 
0000 0000 0000 0000 0000 
: 5 . 0000 0000 0000 0000 0000 
[19120]  .8824 6000 6000 36. 0000 .3600 
| 40 [10 6000 15. 0000 5145 . 6000 . 6000 
А 5] -.9756 -.8000 -. 8000 64. 0000 . 6400 
| 4|45 -. 8000 -20. 0000 . 6247 . 8000 . 8000 
[20[60 0000 . 0000 . 0000 . 0000 . 0000 
4 5|15 . 0000 . 0000 . 0000 . 0000 . 0000 
5 [33] 33 .9412 . 1035 . 4706 22. 1453 . 2215 
4224 10. 5600 .4258 ‚4106 . 0000 
63433] 1.0000 1. 0000 ‚4925 24, 2593 ‚2426 
33| 0 .4356 10. 8900 . 4418 . 4925 . 0000 
[284] 1.0000 1. 0000 ‚0101 ‚0102 . 0001 
1| 0 . 0004 .0100 .0101 ‚0101 ‚0000 
3/2129] 1.0000 1.0000 . 9608 92. 3106 ‚9231 
9| 0 .9604 24. 0100 . 6928 .9608 .9592 
49[50] 1.0000 1. 0000 . 1005 1. 0101 ‚0101 
9-1] 0 . 0200 . 5000 ‚1000 ‚1005 ‚0196 
vle 1. 0000 1.0000 1.0000 100. 0000 1. 0000 
0 . 6400 16. 0000 ‚1071 1.0000 1.0000 
- .9866 . 8481 . 7987 63. 1951 . 6380 
1 4708 11. 7700 . 6241 . 1987 . 6667 
i3L2L3] -. 9686 -.7757  -. 4976 24. 7604 ‚2416 
т [94 -. 0740 -1. 8500 . 4455 . 4976 .1250 
13 [98 L3] 1.0000 1. 0000 .0177 .0312 . 0003 
.0012 . 0300 .0177 .0177 . 0000 
98] 1.0000 1. 0000 . 1035 49. 4949 ‚4949 
14 0392 . 9800 .5754 . 1035 . 3333 
Б 45]  .0000 . 0000 . 0000 . 0000 . 0000 
5 . 0000 . 0000 .0000 . 0000 . 0000 
of ше 
symmetrical, symemp-cosymemp and symg-cosy- which is always more suitable than ot ker” gai 
mg are Zero, while other parameters are not zero. same type for our purposes. Let us noW 


In conclusion, there is no one parameter in Type 2 Type 3 and Type 4 parameters. 
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Discussion on Type 3 and Type 4 Parameters 


Я Though the parameters in Types 3 and 4 do not 
үрне where the cells are emptier than expected, 
wh values may indicate the presence of cells 
ad are considerably emptier than expected. Q 
ie ee the presence of one or two empty 
and T y taking the value +1 ог -1. Q, Y, Vand 
solt au-c rank in that order inthe size of their ab- 
eo S RUE. Chi-square, mean sq uare contingen- 
5 nd delta are not useful for our purposes because 
od values depend on the size of N. For two by 
table, T is equal to the absolute value of V. 
P does not give values useful for our purpos- 
In d gives values similar to T most of the times. 
is di Mary, none of the parameters in Types 3and 
^ an. Шу useful for discovering implicational 
Prosana PS» except Q and Y, which indicate the 
alive nce of an (two) empty cell (s). High absolute 
Кеў: of V and high values of T indicate equivalence 
lonship (two-day implication). 
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eting circulation of the several papers of the panelists 
tual meeting in New York, there was no deliberate pre- 


meeting cross-fertilization or “contamination” of points of view in the development of 
of these reports. Though each paper approaches the topic from a different vantage point 
all four papers have a com mon aim, i.e., the examination and description of teacher 
behaviors in a classroom setting. This examination and description, presumably, will 
permit an analysis of those behaviors with an eye to understanding 1) their bases and 
origins, 2) their impact onthe learners andthe learning process. The research outlined 
by these papers represents something of a new swing, perhaps, in attempting to predict, 
control, and explain teachin -learning behaviors. The focus in these studies is largely 
On operationally described teacher behaviors, and is founded on the socio- psychological 
premises that have been enunciated by Getzels and Thelen’, Jensen?, and others. 
Flanders, for instance, has developed some insights regarding the sequential and 
predictable character of teacher-learner interaction. He has described an observation- 
altechnique for assaying these sequences of behavior and then uses these assessments 
in programs of in-service education with experienced educators. А | й 
Mitzel and Medley, on the other hand, have tried to study teacher “effectiveness 
through the study of the emotional climate, subject-matter or verbal emphasis of the 
teacher, social organization and control in the classroom. They believe that much of 


ou i ed up blind alleys and what is direly needed are definitions 
previous research has евз” perhaps along the kinds of lines specified in 


1) o: ; : 

i acc pe perational definitions of the teacher’s classroom behav- 
iors tê purpošs of the development of these definitions is the relating of the 
dimensi i cher’s behaviors. 

— — of CO hive iae T еннан о. 
called сео characteristics and late a i is a inter- 
action patterns to the identified person tics ar men pac here or types 
Of teachers, Ryans?, of course, €: Gal: 

Ў É dep с sty 
of iene 71 the if tne teacher uses in his et ts to instruct learners. In examining 
the communication behaviors of teachers the Wiscons? 


flicti š d a teacher which t MI 
in ШЕ hoe at рее separation experience and the concomitant transition from be- 
: ng her teacher- 


being a receiver to being a sender in 
Ing a stud tudent-teacher or from 
ent-learner to $ 


€ communication network. 
implemen 
Ita hat some move to Imp. 
by Gages begins а emerge in these studies, „бае j^ pi > 
teaching in the classroom has been value-la 


Since there was no pre-me 
among themselves prior to the ac 


t the metatechnique of research advocated 
gested that much research on 
o assess the social utility 


or effectiveness of the teacher and her methods. He suggests, instead, that research 
on teaching should aim ata‘‘....descriptive, ethically neutral, science of teaching. ... А 
The four papers presented at a meeting of Division 16 of the American Psychological 
Association appear to point in that direction. 
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Чех. PAPER will be presented in two sections: 
influen will raise some questions rega rding the 
action ce of teacher personality onclassroom inter- 
Cate iS recall some available information, and indi- 
Volveq me methodological problems that are in- 
Some р The second section will present results of 
Some esearch that may offer clues to answering 
Of the questions indicated in section one. 


I 


азы Without some experimental evidence, we are 
e nua a number of different points in this paper. 
Personalir Y assumption is that the measu rabl e 
Study of ity traits of a teacher are important in the 
Questio Classroom interaction. Next, we do not 
Pupils n the premise that how much or how well 
dire learn in the classroom under the guidance , 
Clas. 0 Or supervision of a teacher is related to 
Srva, interaction. Finally, and with some res- 
ma "> We assume that classroom inter action 
liable assessed, or evaluated in some kind 
de Utili Jective manner. 
“Part zing these three statements as a basis for 
re, here then is our thesis: 
an he analysis of classroom social interaction 
ere geed best if attention is directed to the 
Onality characteristics of teacher and pu- 


of re- 


ы 1 m 
m Personality traits, or as identifiable, 
in Sonality patterns, are covariants in study- 

of varying 


x е differential effect on pupils. { 
Stare or qualities of classroom interaction. 
Orta M traits condition, modulate, promote 
dire," responses from pupils; they activate, 

Ct, formulate pupil reactions in the class- 
teach learning situation. They are basic to 
fun ıS and pupils working together success- 
dej, Some quest for knowledge, skills, un- 
ding and attitudes. It seems inadequate 


* 


бо 
Note 
Š Will be found at the end of the article. 


to consider classroom social interaction inde- 
pendent of the teacher and pupil personality 
traits. 

How to utilize these personality traits is admit- 
tedly a problem of some magnitude. When we speak 
of the teacher’s personality, the situation is imme- 
diately confused and we think of the numerous stud- 
ies in which personality traits of teachers were 
found to be essentially uncorrelated with the nebu- 
lous quantity termed teacher effectiveness. How- 
ever, difficulties in using personality traits as we 
have implicitly suggested here — as co-variants in 
the study of classroom interaction — appear meth- 
odological. When personality data are collected, 
using an inventory that has some degree of external 
validity (as compared with one having only logical 
or fact validity), and these data are related to hap- 
penings in a classroom, i.e., pupil behavior (as 
compared with ratings of what individuals think hap- 
pens in the classroom), the evidence appears to in- 
dicate that personality factors do indeed contribute 
to classroom social interaction. 

Although other studies mightbe summarized, and 
undoubtedly some of the recent research of a num- 
ber of members of this panel could be mustered in 
support of our statements, we will base our further 
remarks on the data of our recent study dealing with 
the evaluation of laboratory training in human rela- 
tions. Some of the data have been reported in 
other papers, and some have been reinterpreted for 
this paper. Briefly, data were collected from fifty- 
four volunteer elementary teachers who were work - 
ing in two school systemsin Tennessee. Four atti- 
tude and personality inventories were completed and 
a test of the cooperative group problems solving 
skills of the pupils in each classroom were admin- 
istered. The inventories? included the Bowers 
Teacher Opinion Inventory (BTOI), a m ea sure of 
attitudes toward teaching that are predictive of job 
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satisfaction; the Survey of Educational Leadership 
practices, a self description inventory of the ideal 
and actual teaching situation as a teacher perceives 
it; the Minnesota Teacher Attitude Inventory (M TAI), 
which purports to measure teacher-pupil relation- 
ships; and the Minnesota Multiphasic Рег sonality 
Inventory (MMPI), scores on a number of Special 
keys in addition to the usual clinical keys. the class- 
room observation instrument used was Medley and 
Mitzel's Revised Observation Schedule and Record 
(OSCAR). It was scoredon three factors: ‘‘Emotion- 
al Climate, ’’ the degree of warmth and supportive- 
ness which characterized the classroom; ‘‘ Verbal 
Emphasis, ’’ the extent of teaching done by reading 
and written work rather than pupil-pupil interaction; 
and **Social Structure," the frequency of occurrence 
of pupil groups working without the teacher. In ad- 
dition, the Russell Sage Social Relations Test, a 
measure of skill in cooperative planning and work 
was also administered to each classroom. Thede- 
sign involved an experimental and control group of 
teachers; all measures were collected prior to and 
following laboratory human relations training being 
completed by the experimental teachers. 
In the preliminary analysis of, these data, uti - 
lizing pre-training scores, Rippy? showed that ob- 
served data from the OSCAR relatedat a significant 
number with certain MMPI factors. When we later 
related MMPI data to the number of group activities 
involving some teacher-pupil affective relationship, 
the same general findings were indicated. Whenthe 
two analyses were compared, it was interesting to 
note that for the most part, those personality traits 
that correlated significantly in one instance also 
correlated significantly in the second. Utilizing the 
post-training data, and subjecting the data to a some- 
what involved statistical treatment — the Johnson - 
Neyman test — by and large the same keys seemed 
to be the more useful as covariants. In the analy- 
sis of the data, a second item became important. 
When the mean differences on the measures were 
tested, betweenthe experimental and control groups, 
non-significant results were indicated. When all 
classroom behavior data were analyzed and pre- 
test scores on these data used as covariants, no 
great umber of significant differences were found. 
However, when the personality scales wereused as 
covariants, and complex statistical analyses made, 
differences were located. Thesedifferences, how- 
ever, were between certain designated ranges of 
scores on the MMPI, and indicated that teachers 
within the experimental group reacted differently to 
the training procedure. Thoseteachers who reacted 
differently to the training appear to have differential 
personality traits. Stated in a slightly different 
manner: Those teachers who differedin personality 
traits also differedin their reactionto the training 
procedures a8 indicated by measurements taken in 
their classroom in terms of pupil and teacher be- 
havior and pupil skills. 


These findings do show that there is some sup- 
port for our thesis as stated earlier, viz., that 
teacher personality traits are important to the anal- 
ysis of classroom interaction, and with the solution 
of certain methodological problems, perso nalit y 
traits can be used as covariants in studying class- 
room behavior. Other questions pertinent to this 
discussion, of course, can be raised: 


1. Which personality traits are the most usable 
as covariants to classroom interaction? 

2. Is there a hierarchy of personality traits that 
seem to condition certain kinds of classroom 
interaction as compared with other kinds? 

3. In the absence of certain teacher personality 
traits, how canclassroom interaction solely 
between pupils take place so that learn ing 
can proceed? 


These and other questions are being studied, and 
will be reported at a later date. 


II 


The following results are primarily those of à 
Series of canonical correlations which have recently 
been run on the data collected in the earlier projec” 
In brief, canonical correlation derives combining 
weights for creating two composites — one of pr 
dictors; the other, multiple criterion me asures * 
The two sets of weights are such as to maximi 
the relation between the predictor composite por 
the criterion composite. In particular, there ne 
some possibilities which the inventory score ipt 
bining weights seem to suggest as teacher pers 


А Z : in^ 
ality characteristics which relate to differential 1 : 
me o th 


egree by 


Johnson-Neyman analyses reported earlier: op 
If we take the composite of the four erite 
measures as defining ‘‘good’’ teaching, SIM" себ 
ously on four dimensions, at least for the рот on 
of the moment, then we can look at the relative 
tribution of each personality or attitude mea 
to the prediction of this composite. pation 
The measure which shows the strongest re 1. 
ship is Pd (psychopathic deviate ) from the 
Followed, by some margin,are Sc (Schizophr 
and Hy (Hysteria), which reverse rank from av” 


e 
analysis to another, butare consistently les? Prob" 
ily weighted than Pd. Following these, k: psy 
ably not differing from each other, are ТАЈ, 


chastenia) and Hs ( Hypochondriasis ); the M ге“ 
and ће BTOI. Parenthetically, most of E 
dictive power is included in the first four key?" pe 
four alone correlate . 62 with the composite pre 
ten best keys from 19 scores on the MMPI rot аё 
late .67. When the probability of fitting Satar a 
a consequence of the larger number of na 
and choice from a still larger number of P 
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ties is considered, it seems quite doubtful that any 
real increase in validity results from either the in- 
Crease in number of MMPI scores, or adding the 
Other three inventories. That is, it seems quite 
Probable that four keys of the MMPI summarize all 
the inventory variance which is relevant to these 
Particular criteria. 
- Looking at these data, one can speculate a bit 
ane what the underlying dimensions may be which 
ti ° represented in these keys. Admittedly subjec- 
ve, it seems that such a picture as this might 
emerge: 
mat Pparently, the most critical dimension is the 
io و‎ responsibility, depth of affect and ability 
in eel personal and social loyalties which is miss- 
“aes high Pd teachers. Following, and less effec- 
Bellas, discriminating qualities of classroom inter- 
n, are the maladjustive tendencies measured 
Bes which block effective inter relationships. 
as Strom and Welsch characterize high Sc people 
ent `` **constrained, cold and apathetic or differ- 
suffi : . remote and inaccessible, often seemingly 
Deo Ts unto themselves." Whereas high Pd 
Whe € do not feel normal anxiety, these are people 
are blocked by anxiety — so caught up in their 
n intrapersonal concerns as to have little inter- 
of sar energy for others. Inshort, they have little 
Other to share, and have difficulty relating to 
oe despite concern about feelings of alienation. 
Breen ably the third dimension would be the 
i ve tendencies underlying Hy. Presumably 
кү importance in the distortion of perception 
Ein 160 with it. Effective relations are built on 
n perception of self and others, andan hon- 
presentation of self to others. 
Wo he fourth of these is difficult to interpret. It 
ммр 06 atoss-up whether Pt or Hs from the 
Would Were included, but the troublesome thing 
Would ты the weighting either would require. Either 
Scores ave to be weighted in such a way that high 
Soncei Predicted ‘‘good’’ teaching. While Pt might 
Sibi ably be interpreted as concern for respon- 
ther Ìty-taking, as carefulness or thoroughness, 
Ex appears no reasonable interpretation of Hs. 
bla, сен for the latter two, which tie for fourth 
be put all of these measures, as interpreted, can 
alit, — gether into a coherent picture of person- 
tions resources basic to skillful interpersonal rela- 
tion P S. It would look like this: Skillful inter- 
Papers pupils requires on the part of the teacher 
i Pequin Y» and depth of affective pe ien 
Yoh or o that she be well enough adjuste Ш 
with er ot energy is not drained off in de ing 
re able ү їп intrapersonal tensions; and she pe 
o Prese 9 perceive herself and others clear y ses 
Where. nt herself honestly in communication Wi : 
tee this teacher must, in short, care; must ss 
à "Sion. COncern blocked by her own intraperson 
nq othe, and she must be able to perceive herself 
"S clearly and represent herself honestly 


in communication with others. A teacher must, in 
Short, care; must not have this concern blocked by 
her own intrapersonal tensions; and must be rela- 
tively free of distorting mechanisms, and able to en- 
ter honestly into relations with others. Perhaps 
what this reduces to is that a teacher must be able 
to use her “self” openly, clearly, and honestly in 
her interactions with pupils. 

These are not new ideas, but attempts to meas- 
ure and predict have not commonly resulted in rela- 
tionships this high. Perhaps the difference is 
attributable to relating the MMPI, a more subtle and 
sensitive measure than most, to relatively objective 
observations of teacher-pupilbehavior. The appli- 
cation of multivariate statistical procedures prob- 
ably plays its part, too. 

Several added comments seem appropriate. 
Principal is the caution that the analysis has not been 
cross-validated. Data arealmostcompleteto rep- 
licate the analysis, butit has not yet beendone. Fur- 
ther clarification, by factor analysis, is in course. 
Another is the possibility that item analysis may 
result in a new key which will compare favorably 
with the composite predictor score in validity. The 
several keys overlap considerably, and presumably 
each possesses considerable contamination, so that 
selection of the valid items from each might well 
improve and simplify prediction. This is also 
under way. Finally, there is the question of what 
relationship may exist between classroom interac- 
tion and the many different facets of pupil achieve- 
ment. Carefully defined studies inthis area should 
result in helpful data, ultimately useful in the se- 
lection of teacher education candidates, the prepa- 
ration of pre-service teachers, and the profes- 
sional development of teachers already in service, 
as well as helping to increase understanding of the 


teaching-learning process. 
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The 1960-61 Inservice Training Project** 


hine THE REMARKS to be made here are based on a 
tea. Sek inservice training program in which 55 
from T participated. Most of the teachers were 
Syst Wo junior high schools located in a suburban 
the sed near Minneapolis. They met together with 
t dining staff at regularly scheduled classes for 
oe of 30 hours. Most teachers spent additional 
0 Merge а eens with each other, bg staff 
Corder? or simply working alone with a tape re 
All teachers were observed for about six hours 
Paine the fall before participating in the inservice 
inge, Ë program, and again in the spring after the 
took Vice training. Late in the fall, each teacher 
fg, the Minnesota Teacher Attitude Inventory, both 


Or ) 
and iP Of the Cattell Sixteen Factor Personality Test, 
of 9 € Runner Questionnaire. These gave us а total 

sfor each teacher on 


Various es and provided score ic 
dents S attitudinal dimensions. Inaddition, the stu- 
tity Of these teachers responded to a test of their 
ај 1065 toward their teachers before the inservice 

ning, near the end of the nine-week training, and 
tegi?» four to five weeks after the training. Similar 
hs enata Observations were made on a control group 
hser yj ers who did not participate in the nine-week 

^ training course. 

year t hough we have set aside the 


тең. 10 Carr is of the 
Urne, IY Out an analysis O 
Who 15° of our analysis indicate that the teachers 


Cha, Par ticipated in the inservice training made 

һау Бев in their patterns of spontaneous уай! Бе 

ting, at were statistically significant and in à 

Seri lon Consistent with the obj ectives of the in- 
Ce raining, 


dur; 


coming academic 
data, the “early 


rt 


Oth 

e 

Rese, Authors of this study are: P 2 

vto €^ Assistant, now at western Res 
Tank, New Zealand; and Theodore 


by 2 grant 


innesota, School of Education; 


eter Clarke, Research 
rve Universit, 


Storlie, Rese 


1 np : Š e members of the 
Mini ark, Illinois, All wer for their help an 


training staff. 


d cooperation. I | 
S. Office of Education, N.D.E.A., Title VII; by the Uni- 


Interaction Analysis as a Training Tool 


Today's symposium is concerned with concept- 
ualframeworks for understanding teacher- pupil in- 
teraction. This means that we are here to share 
our most favorite concepts that we find most useful 
in analyzing classroom interaction, to show how 
these concepts can be organized into a framework 
of ideas, and in the case of this study, to show how 
a particular framework of ideas can be used in an 
inservice training program. 

The ideas that we have found most useful have 
grown out of our sy stem of interaction analysis. 
Let's take a moment to describe this observational 
procedure. 

Suppose an observer is trained to classify the 
verbal statements of classroom communication into 
one of ten categories once every three seconds. We 
arbitrarily assign seven categories to teacher talk, 
two to student talk, and leave one for silence or con- 
fusion. The categories of teacher talk are: lectur- 
ing, giving directions or justifying authority —which 
we call direct influence; and asking questions, clar- 
ifying student ideas, giving praise or using student 
feeling constructively—whichwe call indirect influ- 
ence. 

We assert that direct influence tends to restrict 
the student’s freedom of action and indirect influ- 
ence tends to expand freedom of action. 

We assume that there is some optimum balance 
of direct and indirect influence, which changes from 
one class activity to the next (for the same teacher) 
which will maximize learning. 

The two categories of student talk are: 1) talk 
made in response to ateacher-initiated contact, and 
2) talk initiated by the student. Observers are 


Assistant, University of Minnesota; Lillian Davies 
Richard Dawson, Research Assistant, now in Well- 


h Assistant, now with the East Leyden High Schools 
, 


We are also indebted to the teachers and 


Board of the participating school district. 
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trained to classify most student statements in the 
response category unlessclear evidence to the con- 
trary is present. А 

The categories are mutually exclusive of each 

other and totally inclusive of all verbal phenomena. 

Since the observer makes a classification once 
every three seconds, this represents twenty per 
minute, or 1200 per hour. During last year’s pro- 
ject, we accumulated about 150,000 bits of informa- 
tion during the fall observations and another 150,000 
during the spring. 

The observer records his data by writing down 
the category number every three seconds. The col- 
umn of numbers preserves the original sequence of 
events. 

We tabulate these numbers as sequence pairs, 
two numbers for each pair. The tabulation is made 
on a ten by ten matrix, the first number to indicate 
the row andthe secondto indicate the column. Each 
pair overlaps the next so that a number is used in 
one pair to indicate the column and in the next to in- 
dicate the row. The arduous tabulation procedure 
was facilitated by a portable Observer’s Punch and 
Electrical Matrix Tabulator built by the Minneapolis 
Honeywell Corporation. 

The column totals of such a matrix show the 
proportion of time spent in each category. The 
other 100 cells of the matrix reveal the frequency of 
two events within the category system. 

During an hour of classroom observation, us- 
ually anumber of quite different activity periods oc- 
cur. The first period may consist of three to five 
minutes of administrative routine as the class settles 
down to work. The second period of five to fifteen 
minutes may be a discussion of some homework. A 
third period may involve planning some work or in- 
troducing some new material. A fourth period may 
be devoted to individual seat work or a group activ- 
ity period. And so the hour goes. 

We have found it useful to tabulate these differ- 
ent activity periods on separate matrices. This 
permits a teacher to compare matrices and see how 
his influence pattern varies from one activity to the 
next. 

We have found it necessary to be most cautious 
in showing teachers their own matrices. Our caution 
is expressed by the following rules: 

1. No teacher sees his matrix until after he un- 
derstands the observation procedures of ma- 
trix tabulation, and has tried his own hand at 
observation. 

2. We prefer to present matrix data after some 
question arises in a teacher conference, the 
answer to which can be found in the data, 

3. We prefer to present matrices two or more 
at a time sothat the centralfocus is on ques- 
tions that compare two or more situations. 
(Whena teacher sees just one matrix he tends 
to ask the question, “Is this good or bad?" 
Onthe other hand, whentwoor more matrices 
are present, value judgments seem less 


urgent. ) 

4. We prefertohaveatrained observer-consul- 
tant present whenthe matrices are interpre- 
ted during the early phases of training. This 
consultant should be skillful in handling de- 
fensive behavior. As a training tool, Ө. 
action analysis provides the teacher with 
relatively objective data about his own er 
havior. Being exposed to this kind of fee TY 
back threatens mostteachers. It is not E 
prising that we found a wide range of initia. 
reactions to the training procedure. 


Some Observations on the Training of Teachers 


In our opinion, too many of our teachers ei" 
sense of experimentation with regard to their Pus 
behavior. Their skills for exploring different be ў 
bal patterns іп the classroom are severely lim! io 

First, they have too few concepts that refer a 
behavior. Their inability to conceptualize their EN 
periences consistently means that the developme 
of insight is less efficient. They don't learn eno" 
from their day-to-day experiences. ing 

Second, they have too few tools for gather 
information systematically. Most teachers are hey 
terested in the attitudes of their students, butt Ex 
have no systematic means for gathering this De" 
mation, They would like to know more about ok 
own behavior, but they interpret their own act 
subjectively, in terms of their self concept. 

Third, they lack time to develop, unders 
and use data-gathering tools. 

It is little wonder that many teachers n 
achieve an effective sense of inquiry concerning 
to vary classroom management and how many 
ent roles are available to the teacher. 


tand, 


ever 
now 


Using Interaction Analysis for Inservice Training 
" i ram 
Our first step in theinservice training gene et 
was to create an atmosphere in which teache™ wel 
free to express their attitudes and feelings, 29 үр 
as their ideas. Onthe first day, we used a fi 


" ie 
Specially designed for this purpose. We iret of 
maintain the initial sense of freedom in a num ovid? 


ways. We told them that we expected to P on, 
them with tools for studying classroom interac’ or 
but eachteacher must decide for himself vues 
not to make any changes in his behavior. ad ob” 
couraged teachers to form teams to discuss ® ger 
Serve their fellow teachers. We supported loess. 
ship attempts among the teachers and were 9*7 гү 
ful in creating a steering committee for in? 
training. tS o^ 
Our second step was to introduce сопсер, = рё 
theory that were directly related to the teac e is 
havior and his control of classroom activities to ? d 
The third step was to expose all teach jal’ 
hours of observer training. Each teacher e29 
and interpreted a matrix after observing а C? 


еп” 
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: The first three steps, which we called a ‘‘tool- 
Ing ир” period, consumed about 16 course hours 
Spread over four weeks. 

The fourth step, lastingthree weeks, was called 
the “work period’’. The purpose of this period was 
to helpteachers experiment withthe new tools, either 
11 small groups or as an individual. Trained ob- 
Servers were made available for classroom visits, 
but the teacher was required to initiate the contact. 

he total group met twice during this period to hear 
reports from teachers who were willing to talk about 
eir training experiences. 

The course ended with an extensive evaluation 
of all phases of this project. 


Some Assumptions Underlying the Project 


itie We tried to design the inservice training activ- 
Su 8 So as to be consistent with the following as- 
Mptions: 

l. Only a teacher can change his own behavior; 
no one can change it for him. 

2. Changes in teaching method are personal; 
they involve feelings andattitudes as well as 
new knowledge. 

3. No one pattern of teaching can be adopted 
universally by all teachers. 

4. The most effective environment for change 
Provides freedom to express both feelings 
and ideas, encourages self direction, and is 
free of coercion. 


Braga’ implementation of these assumptions was 
beco а. Тһе very process of training teachers to 
On ue Observers tends to make teachers dependent 
tuni e training staff. The most productive оррог- 
ang. Or helping teachers become more independent 
Boal zh directing in setting and reaching personal 
four week During the work period following the first 


bes, Naturally. not all 55 teachers became ‘‘red-hot”’ 
Al experimenters in their classroom. A few 


Cina 
x So different, some others were still dependent, 
e ey see d of training becaus 
edes cn ind out what the 


tra Perceiveq the суне f 
аске, Е Staff utd tim Жо do. The majority of 
Rup j however worked either alone or in small 
ite e (0 try Out new patterns of teacher influence. 
Каспе ЧЭ1азт of some was contagious. Several 
rody D Conceived of two different methods for in- 
new material in two separate classes oc- 


Cupp Cini 

ta Er aa the sam e day. They would schedule e 

pe aleg „ап compare the two different patterns 
“iment b p on of these ex- 


mentg the matrices. Discussi 
The Was frequent and intensive. 


ducat; 
tion Values Inherent in the Program 


hers made sig- 
t were consist- 
It was also а5- 


1 
ip. Wa, 
ne wit ch Stated earlier that the teac 
ity p Bes intheir behavior tha 
© intent of the training. 


sumed that no one pattern of teacher influence was 
being advocated. To some of our teachers and per- 
haps to some of you, thesetwo statements may have 
seemed inconsistent. 

The major value orientation expressed by the 
staff might be called “the rule of two-thirds." Pre- 
vious research with junior high academic classes 
supports the following generalizations: 1)During two- 
thirds approximately, of all classroom time, some- 
one is talking; 2) about two-thirds of the talking time 
is used by the teacher; 3) about two-thirds of all 
teacher talk is directive. Based on these generali- 
zations, the staff openly asserted that junior high 
level teachers of academic classes are—in general— 
more directivethanthey needto be. While no single 
pattern or sequence of events was proposed, there 
was a general pressureto increase the amount of in- 
direct influence used by teachers. 

To avoid a single styleof teaching, special em- 
phasis was giventothe concept ‘‘flexibility of teach- 
er influence" by which we meant that a teacher can 
adjust the direct and indirect aspects of his behavior 
according to his own plans or the situational require- 
ments of the moment. 

We avoided giving specific suggestions toa 
teacher. Teachers were not told, in an individual 
contact, that they were too direct or too indirect, 
Teachers often reached such conclusions by study- 
ing their matrices. 

With this kind of general pressure, the 55teach- 
ers made significant gains in the use of indirect 
statements. Theuseof interaction analysis was not 
only a trainingtool, buta research tool that permit- 
ted us to evaluate the inservice training by assess- 
ing the overt, spontaneous influence patterns teach- 
ers used in their classrooms. 


Implications for Future Inservice Training 


Interaction analysis can provide feedback, with- 
in 30 minutes, to teachers who are willing to be ob- 
served. Inthe instance reported here, a schoolwide 
spirit of inquiry and experimentation was starting to 
develop. Atraining staff, five filmstrips, trained 
observers, and resource materials were important 
elements of the program. Significant changes in the 
classroom behavior of the participating teachers 
were noted. 

Even greater changes may be possible when ad- 
ditional data-collecting techniques are made avail- 
able to the teachers. In particular, attitude ques- 
tionnaires which students fill out are likely to show 
results directly related to teacher influence patterns, 
The work that Gage is doing at Illinois indicates the 
promise of this technique. Content-free achieve- 
ment tests similar to those developed by Cogan at 
Harvard can also provide teachers with useful infor- 
mation. Attitude information was used for experi- 
mental control and was not available to teachers in 


is project. 
this en workshops in the summer of 1961 showed 
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promising results. The classroom teachers training 
laboratory at Bethel, Maine helped teachers learn 
to collect data that could become the basis of per- 
sonal experimentation. An intensive one-week work- 
shop at Temple University, Philadelphia, directed 
by Professor Ted Amidon, to which each teacher 
brought a 30-minute classroom tape recording, pro- 
vided another group of teachers with an introduction 
to interaction analysis, 

The suburban school system near Minneapolis, 
with whom we worked in 1960-61, plans to continue 


its program in 1961-62 under the direction of their 
steering committee, subsidized by their own board 
of education. | 

The obvious possibilities of enriching exist- 
ing preservice teacher training has yet to be 
tried. | 

Those of us most closely connected with these 
programs feel definitely encouraged about system- 
atic training that makes use of interaction analysis 
where it is supported by a carefully planned train- 
ing program. 
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A TENTATIVE FRAMEWORK FOR THE STUDY 
OF EFFECTIVE TEACHER BEHAVIOR 


DONALD M. MEDLEY and HAROLD E. MITZEL 
City University of New York 


te RESEARCH we have been doing in the Divi- 
ew y Teacher Education of the City University of 
rather К comes from the tradition of educational 
cide t than psychological research. We did notde- 
den study classroom behavior in order to test 
teg elop àny theory of behavior (although we may 
bradas to that) butin order to find out what the 
Oing j es of our teacher education program were 
What in their classrooms. We wanted to find out 
Stig s erns of classroom behavior were charac- 
te € of those graduates who were effective 
achers, g 
i go City University is in the business of prepar- 
2,00 chers on avery large scale; it graduates over 
Prepa fully prepared teachers every year. A fully 
s Ted teacher ought to know how to behavein the 


room in such a way as to achieve the effects 


(S in 
ing lends to achieve, and avoid those he does not 
on pro- 


&r O achieve. What theteacher educati 
duet Deeds to know, then, is which behavior pro- 


5 i 1 
do ;.^ Which effect, and how much; whatit needs to 
the teacher educa- 


tion st Part this knowledge to г 
thi; Student and to develop his ability to behave ^^ 
Bram OV Or, if the ability is not teachable, the pro- 
have Deeds to select only those candidates who 
; 18 ability, 

Stugy; OUr pu dd to this 
an Ying t р rpose to add to 

ot айчы behavior of teachers 
š ae what they do to the € 


knowledge by 
while they teach, 
ffects they have 


a fundamental postu- 
licitly. If we dis- 
teacher and pu- 
ffect the teach- 
some overt 


14; Under; 
nte i. ing this approach is 
8 “1 Should be stated exp 


bi ine; 
> ° від dental contacts between 


^ If this postulate 

y tion Of studying teacher beha 
ef pum be regarded as im 
ег postulate that each b 


vior by direct ob- 


possible. 
ehavior a teacher 


exhibits has a purpose (conscious or unconscious), 
and may be effective in achieving that purpose toa 
greater or less degree. The competence of a 
teacher is defined as the average success of all of 
his behaviors in achieving their intended effects. 
Strictly speaking, we cannot assess the competence 
of a particular teacher unless we know what effects 
he is seeking to achieve. Wecan, however, meas- 
ure certain effects of his behavior and see which of 
his behaviors are followed by which effects. If this 
information were made known to the teacher, he 
could presumably modify his behavior and increase 
his competence. There are as many ways of being 
effective as there are effects to be produced; the 
competent teacher is the one who isable to produce 
those effects he intends to produce. 

Although the degree to which an effect is achieved 
probably varies continuously, we can conceive ofan 
arbitrary point on the continuum beyond which we 
can say the behavior was effective and below which 
we can say it was not. For simplicity’s sake, let 
us assume that this has been done, so that we can 
classify any behavior as either effective or ineffec- 
tive, in terms of any given effect. 

When we speak of an effective behavior, we donot 
mean to imply that it was necessarily effective in 
achieving the teacher’s purpose; we judge effective- 
ness of a behavior interms of the outcomes we 
choose to study. This implies the assumption that 
the effect of a behavior may not depend on the pur- 
pose of the teacher. Behaviors identical in every 
respect except the teacher's purpose should hav e 
identical effects on the pupils, since the pupils are 
unaware of the purpose of the teacher (so long as his 
purpose is not manifested externally). What the 
teacher needs to know to achieve competence is what 
effect each behavior has, so that he can exhibit thos 
behaviors which will achieve his purposes m red 
efficiently. 

Two behaviors are seldom identical in all obsery 
able respects. What wouldseem to bethe sameb Е 
havior сап be quite different in impact according ys 


318 JOURNAL OF EXPERIMENTAL EDUCATION 


who exhibits it. This is what the poet had in mind 
when he characterized the behavior of his mistress 
by observing that 
«Her very frowns are fairer far 
Than smiles of other maidens are." 
The setting or situation in which a behavior occurs 
also alters its effect. There is a time and a place 
for everything. Moreover, when aparticular teach- 
er does a particular thing at a particular time, it 
does not necessarily have the same effect on all 30 
of his pupils. These three points may be summa- 
rized under the heading of the problem of heteroge- 
neity of effects of behavior. Ifa given behavior had 
the same effect on every pupil every time it 
occurred, our task wouldbe simple. It doesn't and 
it isn't. 

Figure 1 shows a scheme in which any teacher 
behavior can be located according to the homogene- 
ity of its effect on pupils. Those behaviors which 
tend to have the same effects on most pupils when 
exhibited by most teachers in most situations would 
fall in Region A. These аге the most useful behav- 
iors to know; these behaviors are the ones which 
should be taught in general methods courses. Per- 
haps a nice warm smile would fall in Region A. 

Behaviors in Region B would be just as useful as 
behaviors in Region A tocertain teachers but worth- 
less to others. If behaviors in Region В are teach- 
able, they must be the result of individualization of 
instruction in the teacher education program. 
Probably the individual teacher learns most of 
these from experience. 

Behaviors in Region C are effective with certain 
types of pupils only. Courses in methods for han- 
dling exceptional children should feature this kind 
of behavior. Research which classifies pupils ac- 
cording to their personality syndromes, levels of 
intelligence, etc., contributes to our knowledge of 
behaviors in Region C. 

Behaviors in Region D would be contingent upon 
the classroom situation. Among the many factors 
which are relevant would be socio-economic factors 
in the pupil'S background, the particular subject 
being taught, the type of school organization, and 
many others. 

Region E includes behaviors which are probably 
not worth trying to teach. If there are any consid- 
erable number of behaviors in this region,it fol- 
lows logically that we will never be able to train 
teachers to a point where every teacher knows ex- 
actly how to behave in every situation with every 
pupil. If most behaviors fall in Region E, then 
teaching is an art — and competent teachers are 
born not made. 

Let us define the overall effectiveness of any 
particular behavior as the distance from the origin 
to its location in Figure 1. This means that the 
most effective behaviors wouldlie in Region A. 
Next would be those in Regions B, C, and D. Be- 
haviors in the three unindentified corners would be 


less effective, and those in Region E would be least 
effective of all. Effectiveness of a behavior so de- 
fined is a function of the total number of teachers, 
pupils, and situations for which the behavior has 2 
particular effect. 

The effectiveness of a behavior could in theory 
be estimated directly if we could draw a random 
sample of teachers, pupils, and situations and count 
the number of times that each behavior was effec- 
tive. This is not practical because it is impossible 
to isolate the effects of individual behaviors. _ " 

We therefore must all fall back on aless direct 
method. We count the number of times each teacher 
exhibits the behavior during a certain time, am 
measure his effectiveness over the same дол, 
Then we try to determine whether the teachers beo 
exhibit the behavior most frequently are the one 
who are most effective, in terms of their average 
effect on all the pupils in their classes. When we 
do this we assume that behaviors affecting only a 


; e 
few pupils — in Region C, perhaps — will у 
lower mean effectiveness scores than nave 


Region A. Thus, less effective behaviors will t€ 
to drop out and only the most effective ones Wl 
remain. 

We operate, of course, un der the as nd 
that there are such things as effective behavio 26 
that is, that not all teacher behaviors аге cluster 
in Region E. A review of past research which шо” 
sought to relate effectiveness to behaviors ob] 
tively observed and recorded — as contraste ate 
ratings — suggests that it is difficult to 180 ne 
specific behaviors which deviate m uch from 
origin. Region E is by no means empty. ef- 

Few behaviors have been identified which anne 
fective in a majority of all the situations in w yi 
they occur. A skillful teacher's repertoire may 
clude many different behaviors likely to PFO) om 
certain effect, and he selects one or another of B n 
according to the conditions which prevail at a d in 
time. Two teachers who are equally succes? what 
achieving a particular effect may have some 


sumption 


c tin 
different repertoires. We have made the opara ze 
assumption that their repertoires will over ^ is. 


or 
v1 re 


that both will exhibit some of the same peha 
These are the behaviors we look for; and і an 
the behaviors which should be easiest to erm the 

A simple-minded, empirical approac 
problem would be the following: 


d^ 

cor 
Observe a large number of teachers, gure 
ing all the behaviors of each one- jte 
the effectiveness of each teacher and i ac^ 


s; pare” 
analysis to discover which behaviors el зр? 


terize the highly effective teachers: үлке 
sampling limits these behaviors may b vir. 
as defining the domain of effective be? Land 

Now just as no single item in à pape ite 
pencil test has a very high validity и 

so the effectiveness of any individu: 
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may not be very high; and just as a test made 
up of several items rapidly develops validity 
greater than that of any of the individual items, 
so the group of behaviors obtained will be more 
closely related to effectiveness than any one be- 
havior by itself. Experience suggests that it 
takes surprisingly few items to produce a sub- 
stantial correlation with effectiveness — it is 
not unusual for as few as threeor four to suffice. 


We have been reluctant to use this approach: 
when the best three or four from a pool of items are 
selected empirically, the shrinkage intheir compos- 
ite validity on cross-validation is likely to be con - 
siderable, unless the original pool is very small. 
A multiple correlation obtained in this way is not an 
unbiased estimate of the correlation betweenthe se- 
lected items and the criterion — it is, in fact, an 
estimate of the highest correlation that can be ob- 
tained with that many items from that pool. In an- 
other sample it is not inconceivable that an entirely 
different set of items might be the ones to yield the 
highest correlation. 

Instead of using this item-analysis approach, we 
have followed the practice of setting up a priori 


blocks of items that show high internal consistency 
— and then correlating the blocks with a criterion 
of effectiveness. Correlations so obtained are 
much less likely to overestimate the true correla- 
tion and may therefore be expectedto stand up bet- 
ter on cross-validation. We have also used factor 
analysis to locate the most homogeneous subsets of 
items, before correlating the factor scores with the 
criterion. Р 

When this works, it results in the identification 
of effective behavior patterns made up of items no 
separately effective enough to be detected. Its use 
is attended by the risk that, by combining behav - 
iors in the wrong way we may cover up what we are 
trying to find. This seems to be a risk we have to 
take. 

That is where our research stands at present. 
We might mention that some behavior patterns ef- 
fective in securing high ratings from supervisors: 
high pupil-teacher rapport, anda wholesome class- 
room atmosphere have been identified, but that no 
progress has yet been made in finding behaviors € x 
fective in stimulating pupil growth. Perhaps thé 
words of John Paul Jones are appropriate here: 
We have not yet begun to fight. 
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ANALYSIS OF CLASSROOM INTERACTION 
THROUGH COMMUNICATION BEHAVIORS 


W. W. LEWIS and JOHN M. NEWELL 
University of Wisconsin 


ve, ТНЕ TEACHER Education Project at The Uni- 
rSity of Wisconsin has chosen as a point of van- 
ze from which to analyze classroom interaction, 
are concept of human communication. In the be- 
at lea the choice of this perspective was motivated 
SBE in part by a negative consideration. It 
effe ed desirable to avoid evaluative points of view— 
sp le of teaching, teaching that enhances the 
o8 lal and emotional development of pupils, and so 
68 observational concepts which value the be- 
6 oat observed as goodor bad are difficult to adapt 
see purposes. The alternative strategy of 
+ ing a research project with no explicit frame 
varj Fence, and simply collecting data on all the 
Soran kinds of behavior accessible to us seemed 
init; Y difficult, although for different reasons. Our 
tial attitude was one of self-conscious naivete in 
ing into a classroom and asking ourselves how we 
d Qui talk about what we saw going on there in a 
Criptive, non-evaluative way, and at the same 
Ce P In à way that would provide us with some con- 
“Pts that would be useful in discriminating between 
rent groups of teachers and pupils. 
n е... the typical classroom there is a teacher and 
goc SSOrtment of children. The teacher spends a 
ín deal of her time explaining things to the chil- 
bjeg talking to them, showing them pictur es and 
the B, and going through demonstrations, all with 
Wha, PParent objective of getting them to understand 
Sem is saying ог doing. She assesses their un- 
ang anding by asking questions, assigning tasks, 
tas Supervising the accomplishment of the assigned 
tio S. The childrenalternately listen, answer ques- 


deme? апа perfo he assigned tasks in order to 
oye Om strate or rese Tur understanding. This 
the eq mPlified way of talking about what we see in 
Vey, SSroom casts the teacher in the role of a pur- 
ss Of information and attitudes designated as nec- 
culty Y for the assimilation of children into the adult 
апд 06. The role of the children is to understand 
i Саке use of what the teacher is presenting. ` 

ар 9mmunication. as we have come to think of it, 
Оез w two or more persons in contact with each 
ihe ot While one tries to “get his point across," and 
ч this Sr tries to «understand what he means." Used 
broad sense, commu nication may be quite 


varied indegree of complexity and affective involve- 
ment—a personmay simply point when asked for the 
location of the pencil sharpener, or he may engage 
in an extended discussion of deep personal signifi- 
cance withaclose friend. In the limiting context of 
classroom interaction, our attention will be focused 
mainly upon the cognitive content of communication 
as the vehicle for analysis, although recognizing 
that there will almost always be emotional overtones 
contained in the content. 

The two major roles implied when one thinks 
about communication are those of se nding and re- 
ceiving. These two roles are conceived as broad 
orientations or sets extending through varying per- 
iods of time, depending on the nature of the interac- 
tion, and as alternating from one mem ber to the 
other from time to time. If *'information"' is used 
as ageneral descriptive term denoting the facts, 
concepts, relationships, attitudes, opinions, etc., 
about which com munication takes place, we may 
make a distinction between sending and receiving as 
a general orientation by noting to whose information 
most of the attention is being paid in a particular 
interaction. As far as smaller, discrete units of 
communicationare concerned, suchas a single com- 
ment by one person, they are embedded in a broad- 
er context of the attempts of one member of the in- 
teraction to impart information tothe other member. 
The person assuming the role of sender as a broad 
contextual orientation may give information, or 
opinions, may ask questions, or listen to replies to 
his questions, all with the set to get a point across 
to the other member of the interaction. Both per- 
sons focus their attention, for the moment, on the 
information being sent by the member of the inter- 
action whose major role is that of sender. 

In formal educational settings, the teacher's 
major communication role is that of sender of in- 
formation, while the student’s major communication 
role is that of receiver of information. The student 
in a teacher-training program is in a particularly 
interesting position in regardto these two roles; he 
is, by this definition, a receiver, but his attention 
asareceiver is being focused on his anticipated 
role as a sender. Inthe transition of the student- 
teacher from receiver to sender, it is usually 
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expected that there will be some influence on his at- 
titudes towardor approach to teaching by the teach- 
ing to which he himself has been exposed. The effect 
on the student’s sending role may be conceptualized 
in two ways: 1) a direct effect, something like imi- 
tation, in which the communication patterns of the 
college instructor are in some way reflected in the 
communication patterns of the student when he be- 
comes ateacher, and 2) an indirect effect, not ac- 
cessible to direct observation, inwhich the student’s 
role conceptualizations of teachers and teaching are 
modified. 

In the Wisconsin study, elementary education 
majors are being systematically exposed to one of 
three different instructional approaches. The di- 
rect effects of the differing instructional approaches 
are beingassessed by means of a fourteen-category 
classroom observation of the college classes, fol- 
lowed by the same kinds of observations taken in the 
classrooms of the students after they become teach- 
ers. The behavior recorded by the observation cat- 
egories involves relatively little inference or eval- 
uation by the observer, and is designed to provide 
summaries of the teacher’s communication pattern 
at the level of the individual response. These rec- 
ords may be summarized into broader categories 
reflecting the proportion of time a teacher adopts a 
sending orientation or a receiving orientation. Or, 
alternately, the records may be summarized to pro- 
vide distinctive patterns characteristic of a partic- 
ular classroom such as “asks for and gives infor- 
mation, ’’ or ‘‘asks for opinions and listens. ’’ 


Approach Sending Receiving 
Concept-Oriented (I) . 4635 . 4878 
Case-Study (II) „5129 . 3489 
Learner-Centered (III) .3055 . 6163 
z I-H * 3. 721 4.823 
z I-III* 5.505 4. 386 
z  II-IH* 9. 126 9.095 


* All z's significant beyond .01 level. 
Frederick E. Croxton and Dudley J. Cowden, **z- Test 
of Significance of Differences Between Proportions,’ 


from Applied General Statistics (New York: Prentice 
Hall, 1947), p. 338. 


The above table summarizes one such way of 
categorizing teacher behavior inthe classroom. Ex- 
amination of this table indicates that the concept- 
oriented instructor assumed a sending-orientation 


or a receiving-orientation about equally often. The 
case-study instructor tends to emphasize a sending- 
orientation while the learner-centered instructor 
emphasizes a receiving-orientation. These data 
are offered as an illustration of the way we plan to 
talk about classroom communication behaviors. 


The indirect effects of the different instruction- 
al approaches, the way the student-teacher thinks 
about teachers and teaching as opposed to the way 
he acts inaclassroom, are being assessed in à 
number of ways before and after the period of exper- 
imental instruction. For example, the semantic 
differentialtechnique is being usedto obtain descrip- 
tions from the student-teachers of the kind of per- 
sons they would like to be, and the kind of teachers 
they are. The same technique is being used to col- 
lect their descriptions of significant senders after 
whom they might modeltheir own teaching-role con- 
cepts, including their favorite teacher and the teach- 
er who supervises their practice teaching as wel 
as the instructor inthe experimental section. pati 
of these potential models may be used as pletri 
mark from which to plot change in the student-teac 
ers' self-descriptions during training. tic 

We asked our subjects to complete a seman x 
differential form on their educational psychology 1? 
structor and their perceptions of themselves V 
teacher at the beginning andthe end of the acaden 
year. Usingthe procedure setforth by Osgood et н; 
wecomparedthe discrepancy between these din 
tests, pre versus post. We wereinter Moi 
whether or not the subject' s perception of themse in- 
as a teacher would be more like their college pe- 
structor at the end of the year than it was at me gre 
ginning of the year. No significant shifts 
found. We are presently analyzing perceptions 
their potential models. 


It is probably implied in the foregoing pu 
ments that we think there may be some pe. a É 
between the direct and indirect effects of the © ar 
munication patterns to which student-teacher to 
exposed. There has as yet been no opportune two 
explore the empirical relationships between t orm" 
kinds of data we are collecting, nor have relation" 
ulated any conceptual statement of what the T€ ^" at. 
ship ought to be. For the present we must b° зоп 
isfied with preliminary findings that the obser, of 
categories do provide us with different patte s and 
communication in the three college classroom rer 
the indirect measures, suchas the semantic m of 
ential descriptions, look promising as a m 


al 
access tochanges in perceptions and concepts 
teaching, 


ut 
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OF SOCIAL INTERACTION 


| COMMENTS ON FOUR PAPERS 


R. F. BALES 
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e THE DIFFERENCES in approach of the four stud- 
lin, Teported here are marked. Bowers and Soar 
w taken a personality-characteristics approach, 
вла ee a process or interaction approach, Medley 
Te Mitzel a statistical approach with emphasis on 
Plication, and Lewis and Newell a sociological ap- 
role With emphasis on content and perception of 
8. These all representattempts at delimitation 
Simplification. Simplification in one direction 
enp Other is necessary in any particular research. 
What PS the title of the symposium overstates some- 
tual the goals of the separate papers, whichare ac- 
Conc) Concerned with particular studies. If we are 
Oneg ned with conceptual frameworks we have to be 
Vith pM With a good deal more than one can deal 
Conc N a particular study. Moreover, We must be 
erned with the way in which the conceptual 
Siu, WOrk for interaction (the focus of the sympo- 
Hoy ^ links with other and larger frameworks . 
Can we give simultaneous attention to more 
eS at one time? 
Work „WOuld think that a good conceptual frame- 
‘Levert have to formulate a series of different 
S" of information hopefully to be obtained by 


o 
Conte 
elude, analysis of communication. These would 


Е Personality traits of teacher: 
` Qrive arousal or motivation 
Situation 
М defensive maneuvers and indirect expres- 
Sion of latent content 
4, Overt form of the interaction and norms 
5, COncerning it 
6, COnscious message content 
1 gals indicating switches 
i ‚ Content 
it Rt ig ility to deal 
thera Num E004 teaching requires an ability t e 
Waa? апд es of levels of communication suc Ха 
це 8n the 9 foster delicately timed interchanges e> 
5 mor? In general, I feel that the time varity 
important than is recognized in mos 


sand students 
n the present 


in level of 


these studies. But to comment briefly on each level 
in turn: 


1. There is no doubt, as Bowers and Soar 
find, that personality traits of the teacher 
do affect classroom interaction and the 
process of learning. Although the number 
of personality tests is very large and there 
are many systems for describing interac - 
tion, actually the relating of measures of 
personality to measures of interaction is 
clarifying, andis generally consistent with 
the Bowers and Soar findings. One natu - 
rally wishes for personality tests for both 
teacher and students, as wellas for actual 
measures of the overt interaction of each, 

2. It is true, again following the Bowers and 
Soar lead, that individual differences of 
either teacher or pupils are important but 
we also need better ideas of the motives 
aroused іп the teaching situation (apart 
from individual differences), the balancing 
of various motivational states, and their 
optimal pacing in time. Love, fear, and 
aggression must all play a part, and one 
feels thatthe balanceis exceedingly criti- 
cal at times. Howcanthe teacher (and the 
researcher)learnto assess the balance of 
the moment in the particular student? 

3. Canwe differentiate defensive behaviors 
as they are seeninthe process, and could 
they be utilized inthe teaching process by 
teachers? Tosharpen the question, if the 
teacher is required in part to behave like 
a group therapist, do we have frameworks 
that would enable one to describe and 
measure her behavior? The study report. 
ed by Lewis and Newell offers a Starting 
point for identifying one framework under 
the broad rubric “communication. ”’ 

4. Flanders’ study meets some of the Objec- 
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tions I raised regarding the lack of atten- 
tion to the time factor in these papers. 
The matrix analysis that he feeds back, af- 
ter careful training and preparation, to the 
teachers, allows one to trace longer time 
trends. The further extension of this pro- 
cedure seems to memostpromising. It is 
gratifying to get additional evidence at this 
molar level of behavior that feedback to 
learners does bring aboutchanges in their 
perceptions and behavior. Although Flan- 
ders indicates a decided preference for the 
indirect type of teacher behavior, he pro- 
vides measuring instruments which define 
the variables. Additional tools seem de- 
sirable for measuring the attitudinal re- 
sponses of students to teachers. 


The approach described by Medley and Mitzel is 
a statistical and pragmatic one. They assume a 
straightforward atomistic relationship between 
teacher behaviors and outcomes on the students . 
They then propose study of the modification of these 
connections according to 1) the variety of situations 
encountered; 2) individual differences in teachers; 
and 3) individual differences in students. The em- 
phasis on variability, so far as it goes, is good. 
Obviously what one needs in order to make it mean- 
ingful is a classification of the contents of behavior, 
effect, situation, teacher differences and student dif- 
ferences. Without the content classifications, as I 
am sure Medley and Mitzel would also insist, one 
has no theoretical framework at all in the presently 
relevant sense. 

Lewis and Newell deal with roles in communica- 
tion. The roles are identified or defined in terms 


of norms that are recognized as obligations of the 
teacher in the classroom. One would also like tosee 
emphasis on the motivation and manner of RUE 
teacher. Even apart from these additional factor Sn 
however, the study indicates that the style of com 
munication of the teacher has implications for the 
learner. One wishes for further attention to the 
content of the communication. 


ibe con- 


ica descr 
5. How can we systematically does 


tent and cognitive structure? How sca 
one analyze the subject-matter, ite log ч 
structure and symbolic im plications ! 
such a way as to relate it to the nn 
problems it presents in the teaching PI d 
cess? To putthe question sharply e 
pragmatically, if the teacher оре! a 
does as well as a good teaching- mac ше 
program in dealing with the content to 2 
taught, do we have any conceptual cing tt 
work that would enable us to describe 
behavior? awe AE 
6. With regard to some teaching situations ^ 
least, I feel that optimum progress nil 
quires a switching back and forth from acd 
to level in the classroom discourse, D [est 
ample, between attention to the mam 168 
content to attention to the covert ayna gs 
and processes. If the teacher in fact ал" 
this, may there not be an additional ө {0 
tage in the teacher’s making expus he i$ 
learners what he is doing and wha for” 
about as the classroom operation 6005 pink 
ward? If the teacher does this (and s that 
that some do), do we have m ethoc? о 
would enable us to detect and describ 
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CONCEPTUAL FRAMEWORKS FOR ANALYSIS 
OF CLASSROOM SOCIAL INTERACTION 


COMMENTS ON FOUR PAPERS 


B. O. SMITH 
University of Illinois 


or years THESE PAPERS deal in gene al 
Subj caching, they differ in their approach to the 
eee and in their treatment of it. Three of the 
nta S deal with interaction among teacher and stu- 
and N These are the papers by Professors Lewis 
rof ewell, by Professors Bowers and Soar, and by 
êsê 07 Flanders et al. The fourth paper pro- 
in eA à Scheme for classifying teaching behaviors 
sane to their effectiveness with certain types 
each ents, in certain situations, and by certain 
ers, 
Е. рарег by Professors Lewis and Newell ap- 
Oint кы question of interaction from the stand - 
еер teaching as communication. The teacher 
ing to sends or receives information, and accord- 
Of a them, the teacher is primarily in à position 
Mero d They have worked out observation cat- 
S 2 classify teacher behavior as sending or 
of tag ШЕ. When these observations are made 
ener E, teaching behavior may be grouped into 
Study Categories such as concept-oriented, case- 
› Or learner-centered. 

ditte sey then attempt to find ou 
in ү ЄМ classes of teaching be 


I. " 
Who ing — that is, effects 
er Or not the student-teacher takes on the pat- 


r 
hy hi Of teaching behavior to which he is subjected 
Studer training teachers, (b) whetheror not the 
tre che teacher's ideas about teachers and training 
hag panged indirectly by the teaching to which he 


Seem en Subjected. Their observation categories 
tudy of their ef - 


tthe effects of these 
havior upon teachers 
n two senses: (a) 


+ ch 
pis ee ey by Professor Flander 
һа. Known technique for cl 


in to think and act for himself and those behav- 

tes ich tend to restrict the student. Не calls 

Spa rect and indirect styles of teaching 
Clive 

M bined with goal 


en 
онр аве approaches are com 
t dig lon, Professor Flanders 
erent kinds of classroom treatments. 


comes up with 
He 


then attempts to find the effect of these treatments 
upon students in experimental situations involving 
a specified subject-matter of instruction. 

The categories of teaching behavior worked out 
by Professors Lewis and Newell seem tobe similar 
to those of Professor Flanders. The case-study 
category appears to be the same as Flanders' direct 
teaching category, the learner-centered category 
about the same as Flanders’ indirect category, while 
the concept-oriented category of Lewis and Newell 
appear to fall somewhere between the direct and in- 
direct. These are, of course, gross comparisons 
and these similarities might easily dissolve in the 
presence of more detailed information. 

The study by Professors Bowers and Soar seem 
to differ radically from these two papers. It takes 
the character of classroom interaction at the em- 
pirical level as settled by Medley and Mitzel's ob- 
servation schedule, atleast for their purposes. 
They then argue that classroom interaction cannot 
be adequately understood apart from the personality 
traits or patterns of theteachers. This is a differ- 
ent level of analysis becauseit attemptsto account 
for the sorts of interaction patterns found inthe 


other two studies. 
Criticisms 


These papers may be examined from a number 
of standpoints. They can be criticized as to their 
technical adequacy — the statistical procedures 
employed and so on. They can be examined from 
the standpoint of their conceptual adequacy — the 
clarity, inclusiveness, etc. , of their concepts. They 
can be criticized internally — as to their internal 
consistency. Andthey can be examined externally, 
that is, from the standpoint of what they assume. 

тат going to confine my criticism to the exter- 
nal and conceptual aspects of these studies. I 
choose thus to limit my observations for three 
reasons: First, lam more competent to do this sort 
of criticism than I am to do the technical criticism. 
Second, I feel that in our present state of research 
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on teaching behavior it is very important to exam- 
ine persistently our conceptual orientation, to ex- 
pand it, and to avoid doctrinaire and sloganized po- 
sitions. Third, I do not have enough time to look 
at these studies from all angles and must, 
therefore, limit my reactions in some way. 

First of all let mesay thatI think these papers 
are a few of the straws inthe wind — signs that we 
are entering a period of revolutionary studies of 
teaching. For almost four decades we have been 
making study after study inour attempt to measure 
teaching effectiveness. In all these studies we 
proceededas if we knew already what teaching is and 
that all we had to do was to give tests to find out its 
effects. Increasingly during the last decade, stud- 
ies of teaching have been abandoning efforts to find 
out the effectiveness of teaching, and have concen- 
trated instead upon an analysis of teaching behavior, 
knowing full well, of course, thatlater the question 
of effectiveness must be faced. It is interesting to 
note this tendency in the present papers. 

There are in these papers, however, certain 
tendencies which may yield results that will 
later plague us. The first of these is the practice 
of trying to type teaching, to create general cat- 
egories into which teachers and teaching can be 
classified as types. I, of course, have reference to 
terms such as concept-oriented, learner-centered, 
direct and indirect style. Ofcourse, there is some 
empirical evidence for such categories. But they 
are not pure types. I wonder if teaching behavior 
is not always a mixture as Flanders says, and that 
it is never all of this or all of that. At least these 
Studies themselves indicate that this is the case. 
Yet we group these behaviors to show that if a par- 
ticular group is followed, then we get greater 
measured results than if we group them another 
way. I believe that the outcome of this practice 
will be to throw us back again into pedagogical dog- 
mas and doctrines that have burdened pedagogical 
thought throughout its history. Wehave had object- 
teaching, project-teaching, problem-teaching, and 
so оп. Will we have as a result of our current ef- 
forts to analyze teaching behavior a new set of ped- 
agogical schools with their claims and counter 
claims? It seems to me that the work of Medley 
and Mitzel helps to avoid this pitfall. 

I wonder if it is necessary to our research on 
teaching behavior to use these general categories? 
Are we using them because we have not yet carried 
our analysis of teaching behavior far enough to 
avoid them? Are we using them because they per- 
mit us to drag inunwittingly our perceptions of what 
teaching is or ought to be? 

The second tendency that seems to persistin 
these papers is the notion that the affe ctive — 
emotional and social climate — aspects of teach- 
ing are more important than the cognitive — at 
least as objects of study. I do not wish to minimize 
the importance of the affective side of teaching . 


But I wish to call attention to certain facts. In my 


own studies of teaching Ifind that over 70 percenta 
verbal behavior in the classroom is concerned wit 
cognition, with understanding the terms, pein 
facts, etc., of the fields of instruction. About е 
percent is concerned with classroom шёбц y 
and the like, andthe rest is by way of relniprE me 
and encouragement. These figures are only 
tive, and involve only a few teachers at the 
school level. ButI do think they are indicative of : 
importance of cognitive behaviors in the Ser ds 
teaching. It would seem to be thecase that it 15 b й 
as important to know the structure of cogni pe 
teaching behavior as it is to know such things - 
personality traits, social atmosphere, and the ap 
proaches to teaching. н at 
It is well to remember that teaching consists n с 
only in ways of relating to students but also in мау 
of dealing with the content of instruction. Indee i 
the teacher would seem to relate to students throni 
the ways in which he handles his subject-matter s 
often as he relates directly to them as а ym 
And if we would study the affective elem poit 
of teaching, perhaps we should begin to look a 
closely at what goes onatthe point of actual ins they 
tion. One wonders if the teaching operations 25 ons 
go on from moment to moment — those opera than 
involved in handling the subject-matter Tame, M 
the student — yes, one wonders if these are ot 
ten basic factors shaping the students’ perceP H 


саа fes 
of the teacher and of teaching in general. peer 
sors Lewis and Newell recognize this point а done 


tral to their study but so far they seem to have 
little with it. aps 
It seems to me that these papers, except perh re 
for that of Professors Medley and Mitzel, e 1 1е- 
deal with or propose to deal with the grosser m 
ments of teaching behavior, or to deal with br ” 
a distance. Thus the notions of “giving informa" д 
and “receiving information’’ as used by EUER ly 
Newell leave much to be desired. What spec? veh 7 
are the operations by which information 18 E in 
What are the cognitive structures involve yed 
receiving information? The same thing can be * and 
about such general notions as ‘‘giving opinio » as 
facts," and “clarifying and developing ide 


used by Flanders and others. А eseat?” 
I realize full well that we must begin r°”, one 
with vague notions and loose categories. ate“ 


Я jon €^... 
wonders how often our choice of observati eli 


gories is made in the interest of obtaining PE isti 
ability coefficients. How oftendo we sacrificó 
mate association with the more vital parts ^ y o? 
problems because to explore them is to 8° "apre. 
our commitment to high levels of reliability © ду 
dictability? Itmay turn out that success? gre v 
teaching will require that we loosen up b ately ns 
tighten up — that we become more inire io и 
volved with the actual operations of instr" е мё т P 
they are carried on in the classroom befo”? p t 


Š vio 
to relate gross categories of teaching beh? 
the learning of students. 


^ 
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THE MOTIVATION IN SCHOOL OF YOUNG 
CHILDREN: SOME INTERVIEW DATA * 


LEE B. SECHREST 
Northwestern University 


li A PERSISTENT problem in classrooms isthe e- 
pes ration and sustaining of responses of which child- 
n are obviously capable— in other words, the 
t oblem of motivating children to behave in а par- 
ae way. One of the reasons why it is quite de- 
manne to get children to behave is so that learning 
woul be maximized. In view of what most people 
tio d probably accept as the primary goal of educa- 
ied? i. e., instilling knowledge anda love of know- 
t Бе in the child, relatively little attention seems 
€ paid to the motivations for learning. Instead, 
Ore attention is directed toward the eliciting of 
is t Orming behavior or discipline. That discipline 
edue be regarded as secondary to the fundamental 
sta tional goal is indicated by Cronbach, who 
©з that “Discipline is a condition where pupils 


r В : 
Way Using their time in educationally desirable 
y uld be given to 


the ©.’ (5, p. 482) More thought sho 

е Conditions ih ES children are likely to want to 
n, to be eager for educational experiences. . 
ер. Te can be no question that controlled experi- 
are œ> Whether in the laboratory or the classroom, 
the One capable of providing definitive answers to 
Hoya Stions which arise in studying motivation. 


lika Ver, t inds of data whichare 
Ке]. here are other kin = es lij XE 


Ува; O Prove heuristic to experim 

ч in 8 variables and situations patentialy qu Шу 
e y. T investigators ha ж 
m hus, a number of f educational 


Pteq 

ех to “a aa š ture o: 
рег; gain insight into the na 

Que ¢ ces by questioning students, usually by 


Sti, : {= 
8 Onn ; e concentra 
q 9n aire, Most such studies i en approach 


t 
Ud hat’ “What I like about my teacher" PP" e 
© found quite uniformly that P i t Pu- 
o » "ho are good to them 8, 10, 13, Ч (13) 
пе Scop like teachers who are domineering (19); 
aay Stigat? are cross and fussy 
E its Or cd have usedthe retrospe 
Ys er students to gain КПОЎ 7. | 
Most 1001 ER eei = similar findings (2,9) 
"vestigations have, for eÍ 


Ths 
hi thwestern 


"s rted ру North" 
Of Ce in , Carnegie Corporation 
Seno, Collection and analysis © 


istrict No. 65 of Evanston, 


the data. ` 
Illinois, 


University's P 


S in 
Уез; псу Мс 
by the Stigation has been SUPP writer wishes to thank Nancy Mee тр н аваа 


dealt with the responses of older school children, 
but Biber and Lewis (1) used a projective-type in- 
strument to study the school attitudes of first and 
second grade children in a public and a private 
elementary school. While the differences between 
schools are not clearly interpretable owing to the 
lack of statistical treatment of data and to the non- 
comparability of the two schools on many grounds, 
Biber and Lewis' results do appear to indicate that 
young children have rather definite and consistent 
attitudes about school, what is expected of them and 
what the consequences might be of failing to meet 
expectations. As might be anticipated, there were 
definite individual differences among the children 
with some children expecting anger, rejection, etc., 
when most children apparently anticipate help and 
warmth. 

Obviously, more first-hand data about the early 
school experiences of children should be available 
if we are to achieve a reasonably c o m plete under- 
standing of the actual and pote ntial impact of the 
schoolonthe child. There are several desiderata 
for such data. First, with allthe weaknesses of the 
phenomenological andself-report methods, it would 
seem that data should come inthe form of reports 
from the child about his reaction to school. This is 
not to ignore other sources of data, e.g., reports 
by parents (11), but to supplement them. Current 
reports are to be preferred over retrospective re- 

rts. Second, the methods employed in obtaining 
in obtaining responses should be appropriate to the 
roblem and to the subjects being studied. Partic- 
ularly with younger subjects interviews would seem 
to be desirable. Then, there should be an attempt 
made to obtain a sample representing children of 
both sexes and of diverse levels of ability and drawn 
veral classrooms in several schools in or. 
der that the final data do not represent an unneces- 
sarily narroW, biased group of respondents. 
The present study represents a report of brief 


from Se 


sychology-Education Project, sponsor- 
Kiernan and John Wallace for assis. 


p^ facilitated this investigation. 
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interviews with kindergarten and primary grade 
children about their school experiences with special 
emphasis on the conditions under which learning is 
likely to be facilitated. An attempt has been made 
to meet the above suggestions for methodological 
adequacy. The present investigation is not directed 
toward the testing of any specific hypotheses but on- 
ly to the gathering of information which may provide 
a basis for more pointed research efforts. 


Procedure 


Interviews were held with 128 children from four 


different schools of a large suburban school system. 


An attempt was made to interview in schools which 


were broadly representative of the entire system. 


Within each school, some children were interviewed 
from each kindergarten, first, second and third 
grade class. Teachers were asked to select child- 
ren to be interviewed by naming children at differ- 
ent levels of ability and children whowere well-be- 
haved and those not so well-behaved. An equal 
number of boys and girls were interviewed, and 32 
children were interviewed at each grade level. 

The interviews were relatively structured and 
consisted of ten questions requiring an extensive 
reply by the child and ten additional questions about 
specific motivational procedures which could be 
answered yes or no. The ten open-end questions 
were: 

1. When you begin a new lesson at school, what 
kind of things does your teacher doto get you start- 
ed? 

2. What does your teacher do that makes it fun 
to learn new things? 

3. What does your teacher do that makes you 
like school? 

4. How do you feel when your teacher tells an- 
other child that he has the best paper or has done a 
good job? 

5. How do you feel when the teacher tells an- 
other child that his paper isn't neat or isn't done 
correctly ? 

6. How do you feel when theteacher tells you 
that you have a very good paper? 

7. How do you feel when the teacher tells you 
that yours isn't neat or done correctly? 

8. What kind of things does theteacher tell oth- 
er children about their work? 

9. How does your teacher let you know if you 
are doing your work right? 

10. What does your teacher do t hat frightens or 
scares you? (If the child said “Not hing, ’’ he was 
asked what the teacher did that might frighten other 
children.) 

Following the open-end questions, the child was 
asked specifically whether the teacher ever did spe- 
cific things as follows: 

1. Give stars for good work. 

2. Yellat children for misbehaving. 

3. Write nice things on children's papers. 


Put good papers up in the room. 

Tell someone he's bad. | 
Send a child out of the room for misbehavior. 
Tell someone how nice he looks. 

Say she’ll keep someone after school. Really 
keep someone after school. 

9. Say she'll tell someone's mother he’s bad. 

10. Say she likes someone. 

All interviewing was carried on by a young, fe- 
male graduate student in Education. Noc hild rer 
fused to be interviewed. Most seemed pleased to be 
singled out for attention. Responses were recorde 
verbatim for later analysis. 


poca pu emm 


Results 


The results are to be presented in terms of re- 
sponse content categories devised separately d 
each of the first ten questions. An attem pt Wa 
made to devise categories whichwere fairly one 
tent across questions, but there was по ap 
force development of a priori categorizations. “a 
ly the initial statements made by the pupils we * 
placed into categories. The categorizing was ae 
by a single judge but was checked for agreement i 
tween two judges in its use. Categorizing esposan, 
es to three questions, the judges agreed for 94 pe 
cent of the statements. m 

The results are presented in Table I in the ane 
of frequency of response for major categories an 
subcategories. Categories c ontaining fewer e 
ten responses have been omitted from the Table oh 
should be regarded as ‘‘miscellaneous”’ p m 
Because of omissions, it will be noted that the 7,5 
que ncies within subcategories do not always sum 


no 
the major category total. Althoughthere im eii 
particular hypotheses about differences be ificant 


grades, those few differences which are sign te 
at the . 05 level as indicated by x? are indict, een 
There were remarkably small differences be ase 
the responses of boys and girls, and their resp? 
have been combined in the presentation. ;ch may 

There are a number of the findings whic g 
contribute generally to our understanding of pe 
havior of children inaclassrom situation, nat the 
replies to the first three questions indicate the 
children are quite aware of and respon ds jev- 
teacher as a person. Even at the younger = activ” 
els, the children are likely to report that jme jn 
ity and assistance of the teacher i$ impor ever? 
sustaining appropriate classroom Бева respon" 
theless, there are a substantial number О 28 to 
ses that indicate that many children simply The re^ 
like school and the things that go on there. M. 
Sponses categorized under 2B often implied int? 
effect attributable to the introduction of nove 2i you" 
the classroom or to the disruption of no rm were 
tine. Some such responses, for example» snow” 
“Опе day she came outside and show ed al put 
flakes and you know what? We are gonna tre re! 
ter and have a party..." “She puts out О} 
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puzzles, that’s what she did one day to surprise us." 
She puts things another way ifthey were tiresome 
the first way. ’’ and “She doesn’t have us to do some- 
thing all the time. We may do the same paper, but 
we do something different with it each time. "" 

It is of some interest to note that category 3C, 
remarks about teacher personality, seems t o in- 
crease with increasing grade level. Of course, it 
is not ascertainable whether the difference is the 
result of a greater sensitivity of the children or of 
a greater facility in expression, but eventhe simple 
statement that the teacher is ‘‘nice’’ is quite infre- 
quent at the kindergarten and first grade levels. 

Replies to questions 4 and 5 indicate that child- 
ren are apparently sensitive tothe experiences of 
other children although in a somewhat curious way, 
for the older children are less inclined to report 
positive feelings when another child is verbally re- 
warded. They seem somewhat more inclined to re- 
port neutral feelings for both verbal reward and re- 
proof administered to another child. With respect 
to praise and reproof administered directly to the 
child by the teacher, the children are virtually u- 
nanimous in reporting its presumably intended ef- 
fectiveness. 

Vocal feedback, particularly of a positive nature, 
is apparently the most salient technique by which 
the teacher keeps the children motivated, but a sub- 
stantial number of children did mention thattheir 
teacher used non-vocal ways of giving them infor- 
mation about their performance (9B). However, 
kindergarten children are not so aware of such 
techniques as are first and secondgraders, perhaps 
because they are used less frequently. Interesting- 
ly enough, the use of some non- vocal techniques 
may decline by the third grade (9В1). 

Not a great many children re port fear of their 
teacher although there is some persistency of child- 
ren reporting fear through the third grade level. 
The only specific category of fear-arousing stimuli 
reported with any frequency was the creation of a 
sudden loud commotion by the teacher. Allother 
responses involved rather idiosyncratic tendencies 
of the children, whether idiosyncracies of response 
to the teacher's behavior or idiosyncracies of ver- 
balization. 

For the second question involving the use of spe- 
cific motivational and control procedures, the data 
are presented in Table II. Here, perhaps the most 
obvious feature of the data isthat all of the specific 
techniques are reportedly used with fairly substan- 
tial frequency. However, there are some differen- 
ces between the grades, particularly between the 
kindergarten and the primary grades. From the 
reports of pupils, kindergartenteachers аге unlike- 
ly to rely upon stars, yelling, threats of retention 
after school and perhaps threats to report bad be- 
havior to parents. Thirdgraders also do not report 
frequently the use of stars. It will be noted that the 
replies to the first question are consistent with the 
free responses of the children to question 9 above. 


Discussion 


The question naturally arises whether the керо 
of young school children can be taken to be veri гә 
cal with respect to the actual occurrences of € 
in the classroom. We are assuming, of C Or s E 
that their reports are reliable accounts of their en 
views. We suspect that children are also TRE UR 
report fairly faithfully the things w hic hactu c 
happen in school. The extent of agreement betw a 
the replies of boys and of girls, for example, pe 
seem to suggest good reporting. It was ned 
previously that the replies of the childrento à A 
rect question about their teachers' use of stars t 
areward agreed well with their free res po nses 
another rather different question. hild- 

It is quite apparent that theteachers viru d 
ren were interviewed employ a wide variety О: m 
tivational and control techniques. Moreover, 736 
responses to the set of questions about spec? ap 
techniques indicate that most of the teachers ponant 
ently use most of the techniques at one time jet 
other. There seems to be somewhat less of a rten 
dency to use very strict measures withkinderE?" та 
children and perhaps a lesser tendency to be e tad. 
ative about their work, but that is to be ERE rat 
If we assume, as seems justified (4, 5, 12), ant їй 
there are important differences among с hil ела 
their responses to different kinds of motiva ani? 
approaches, then the diversity of tec hniques 
ployed by the teachers is most desirable. 

There can be no question that the childr A 
viewed are quite sensitive tothe teacher as a Рев. 
and that they are affected greatly by what she ach 
Indeed, one of the most powerful incentives а te* y 
er has to dispense or withhold may be her ig at" 
tention. Other investigators have found that th 
tention of an adult is useful in the control of ne. 
havior of young children and that deprivation o To 
tention increases its later effectiveness (6, sein 
be sure, children may change somewhat with Ein 
the characteristics of the teacher which they re 
rewarding or comforting, but in general, they 
likely to be pleased with teachers who Tesh. of 
warmly and perhaps permissively to them. š ad- 
more than incidental interest to discover by are 
ing specific responses of children that they ss 
likely to view their teacher as the more б that 
primary, independent source of the good thing ook 
happen to them and which they receive in $ cm nice 
The children report that the teacher gives ther „зде 
books to read, that the teacher letsthem £9 О ning? 
to play, that the teacher provides all the пісе " ; ow, 
for children to do. From the child's point © M the 
what happens to him in school, good or bad, | 
teacher’s personal responsibility. er іё 

Just how sensitive children аге to eae! ^. jor: 
difficult to determine. In response to the 825 пе; 
“How do you feel when your teacher tells an P 00 
child t hat he has the best paper or has done 10217 
job?", many children report generally pos 


en inter- 


h oth 
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TABLE II 


RESPONSES TO TEN QUESTIONS ABOUT SPECIFIC MOTIVATIONAL TECHNIQUES 
BY 32 CHILDREN AT EACH OF FOUR GRADE LEVELS 


Kindergarten First Second Third Total 
Give stars for good work 
Yes 10 20 17 10 57 
Sometimes 3 3 5 0 11 
No 18 9 10 21 58 
Yell at children for misbehaving 
Yes 9 10 15 4 38 
Sometimes 6 T 10 13 36 
No 16 15 7 14 58 
Write nice things on children’s papers 
Yes 23 27 27 31 108 
Sometimes 2 3 4 0 9 
No 2 2 1 0 5 
Put good papers up in the room 
Y 28 27 23 30 108 
es 
2 2 1 5 
Sometimes 0 
Мо 2 3 7 0 12 
Tell some one he’s bad 
Y 15 16 15 16 62 
es 
8 6 8 5 27 
Sometimes 
N 5 8 7 @ 27 
o 
Send a child out of the room for misbehavior 
3 14 18 18 53 
Yes 
1 5 5 3 14 
Sometimes 
N 23 12 7 10 52 
o 
Tell some one how nice he looks 
Y 20 23 22 19 84 
es 
2 5 4 6 17 
Sometimes 
9 4 5 5 23 
ng Continued 
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TABLE II (continued) 


RESPONSES TO TEN QUESTIONS ABOUT SPECIFIC MOTIVATIONAL TECHNIQUES 


BY 32 CHILDREN AT EACH OF FOUR GRADE LEVELS 


Third Total 


Kindergarten First Second 
8. Say she'll keep some one after school 
Yes 9 21 26 26 82 
Sometimes 1 1 3 4 9 
No 20 8 2 0 30 
9. Say she'll tell some one’s mother he’s bad 
Yes 12 21 14 20 61 
Sometimes 2 2 5 3 12 
No 16 6 9 7 38 
10. Say she likes some one 
Yes 21 25 21 19 d 
Sometimes 2 2 2 0 a 
No 6 5 9 10 30 


feelings. Others, however, especially the older 
children, report feeling quite neutral or indiffer- 
ent. Many of the neutral responses have the sound 
of guardedness or defensiveness. Thus, the reply 
“Not bad" can clearly be seen to be a recognition 
of the potentially competitive aspects of the situa- 
tion. Retrospective reports of experiences in 
school suggest that children are affected by the ex- 
periences of other children, particularly by hearing 
other children reprimanded or subjected to sar- 
casm (2, 3). A useful area of research endeavor 
would be the determination of the conditions in which 
praise and reproof may have maximum effect on 
children other than those praised and reproved di- 
rectly. 


Summary 


Interviews were conducted with 128 kindergarten, 
first, second and third grade children aboutthe ex- 
periences they were having in School. An attempt 
was made to gain some knowledge about the motiva- 
tional factors operating in the classroom and their 
effects on the children. The results indicated that 


young children are able to report r 


the things that go on in school. From the repot 


of the children, it was apparent that most tea 


employ a wide variety of motivational approac es 


their pupils. 


It would appear that one o i 
powerful motivating factors available to the te 
is her own attention to the child, which she 


give or withhold at her will. 


to motivational devices such as stars and m 
their papers and also seem very likely to be 
ed very much by praise or reproof adminis 


other children. 
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PERSONAL VALUES AND VERBAL 
BEHAVIOR OF TEACHERS 
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University of Maryland 


THE PURPOSE of the research reported here 
Was to determine the nature and extent of the value 
Systems of elementary school teachers communi- 
cated through their verbal behavior to elementary 
School children. The specific objectives of the 
Study were: 1) to describe and classify the role-tak- 
ing processes and ideational content of the language 
Used by teachers to influence the behavior of pupils, 
and 2) to compare these asp ects of teacher verbal 
Statements with teacher value systems, those ‘‘in- 
terests and motives of personality” as measured by 
the Allport- Vernon- Lindzey Study of Values (2). 

š Researchers in education have beenconcer ned 
With the study of the impact of teachers' values on 
Students in the classroom for sometime. Bruback- 
er, Friedman, Childs, Corey (7, 16, 10, 11) and 
Others have suggested the possible scope of the 
Sàcher's influence upon various aspects of pupil- 
acher interaction. The degree of acceptance ac- 
COrded each child, methods of teaching used, em- 

asis given different phases of the school curricu- 
"m, and other decisions for action in the teaching- 
Sarning process have been viewed as reflections of 
€achers’ values. The values held by teachers may 
SXert a greater influence in this process than is now 
town, Actually, they may serve as very strong de- 
“rminants of the scope of what children respond to 


and int 
ernalize. 2 | 
Values аг individual’s inner life, 

e a part of an 1 i 

©Хргевзей пеем behavior. From the point of ш 
г е behaver, his behavior represents the ag 
ie effective judgment he is capabile o at D 
(13) © immediate situation. One author, dera 


$ attri tavi 's most significan 
tituq ttributes an individual elf forces. Each 


es cating S 
edid hec Ee gem. icant meanings to 
erts. r 

Derien experiences, to value 
Explains s; and to avoid or ге] 
Бо, ® conditioning which are 
ae en Articularly words. 
they tities which can be observed 
feelin aY be inferred from th 
Ез and actions of individuals. 


facial expressions, bodily movements, symbolic 
and practical objects are avenues for the communi- 
cation of values between and among teachers and 
pupils, the focus of this study was centered pri- 
marily on teacher verbal behavior. For this study, 
it was assumed that value systems of individuals 
exist and are subject to measurement. It was fur- 
ther assumed that verbal statements constitute one 
valid means of inferring an individual's value sys- 


tem. 


Hypothesis of the Study 


The general hypothesis of this study wasthat 
there is a relationship betweenteachers' value sys- 
tems and their verbal behavior. Stated in terms of 
the instrument used, the specific hypotheses to be 
tested were: 

1. Teachers whose value systems are charac- 
terized by a high Religious value score will tend to 
support pupils' actions and statements to a greater 
degree than teachers whose value systems are char- 
acterized by a high Political value score. 

2. Teachers whose value systems show a high 
preference for Economic value will tend to empha- 
size school rules and regulations to a greater ex- 
tent than teachers whose value systems have a high 
Social value score. 

3. Teachers whose value systems have a high 
Theoretical value score will tend to use the prob- 
lem-solving approach to assist pupils in the acqui- 
sition of subject matter and skills to a greater ex- 
tent than teachers whose value systems have a high 
Aesthetic value score. 

4. Teachers whose value sy st ems show a high 
Social value score will tendto emphasize inter-per- 
sonal relationships and concern forthe individual 
to a greater extent than teachers whose value sys- 
tems are characterized by a high Political score. 

5. Teachers whose value sy stem s have a high 
Political score will tend to r eprimand and punish 
pupils' behavior to a greater extent than teachers 
whose value systems have a high Religious value 


score. 
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The Research Sample 
The Research Sample 


After conducting a pilot study with ten teachers 
in one locale, it was decided to conduct this re- 
search in a county public school system inone of the 
Middle Atlantic States where rapport with teachers 
and students had already been established. The lat- 
est census report indicated that 23,415 persons 
lived in the county. The county school staff included 
128 elementary teachers. A random sample of 50 
teachers from this school staff was chosen for study. 

This sample included 49 female and one male, 
representing an age range from 22 to 62 y ears of 
age with a mean of 41. 8 years andarange of teach- 
ing experience from one to 41 years, the mean be- 
ing 15.5 years. The sample included 18 teachers of 
the primary grades and 18 teachers ofthe interme- 
diate grades. Thirteen teachers were teaching 
combination grades and one was fulfilling a special 
assignment in remedial reading. 


Collecting and Organizing the Data 


Teachers' Verbal Behavior— After securing 
permission from school authorities and participat- 
ing teachers, each teacher'sclassroom was visited 
for three one-half hour periods atdifferenttimes of 
day during which time a complete record of all 
Statements made by the teacher duringthe period of 
observation was taken and some supplemental com- 
ments from the children were noted. Theonly con- 
stant factor in the collection of observational data 
was the time element, all periods of observation 
being of the same length. The total number of 
statements made by individualteachers varied from 
241 to 690, with an average of 435 statements per 
teacher for the total time observed. Fourteen 
phases of the curriculum and 176 activities were ob- 
served. Reading instruction accounted for approx- 
imately one-third of the total activities, followed in 
rank order by arithmetic, social studies, and Eng- 
lish. 

A review of research in the areas of propaganda 
and public opinion, psychotherapy, interaction pro- 
cesses in small groups, and written expression in- 
dicated that various systems, frameworks, or cat- 
egories used for quantifying content ha ve been de- 
vised for specific research situations. A general 
framework applicable іо alltypes of content, includ- 
ing feeling, does not seem to exist. It became ne- 
cessary to develop a framework that would provide 
for the assessment of the psy chological states and 
explicit meanings of the verbal expression. 

The framework developed for classifying teach- 
ers’ statements in this study consisted of two major 
divisions: role taking processes for describing the 
feeling tone of a statement and content categories 
for expressing the idea contained in the statement. 
The role taking processes, psychological sets by 

which one attempts to influence behavior, and the 
content categories, the intent of the concept, thought, 


or idea being expressed, were organized according 
to the following framework: 


Role-Taking Processes 


A. Supportive Roles 

Rewards, praises, compliments 
Protects, reassures, assists 
Affirms 

Uses Humor 

Recognizes 

Apologizes 

Reflects 


-] CO» ол C5 tO = 


B. Instructive Roles 
Suggests 
Directs 
Commands 
Explains 


o =‏ م ج 


Non-Supportive Roles 

1. Ignores 

2. Checks, contrasts, corrects 

3. Contradicts, criticizes ake 

4. Shames, threatens, reprimands, uses $ 
casm 

5. Deprives, punishes 


D. Problem-Solving Roles 
1. Fosters creative thinking : 
2. Encourages pupil-teaching planning 
3. Uses scientific methods 


Content Categories 


I. Subject Matter 
H. Standards of Achievement 


III. School Rules and Regulations 
Time—speed 
Orderliness 

Attention 

Raising hands 

Sitting in seats 
Quietness 

Routine matters 

Pupil’s request 

Chewing gum 


سدم م کن م تر م م 


IV. Social Expectations 
Cleanliness—neatness 
Care of property 
Appropriate language 
Sharing 

Taking turns 

Helping others 
Politeness (manners) 
Pupil welfare 
Personal reference 
Fairness 


سروم هرن و = م Ою‏ 


mm 


BOWIE - MORGAN 


11. Truthfulness 
12. Beliefs or philosophical thoughts 


All statements made by each teacher in all ob- 

servations were classified according to role taking 
processes and content categories. Statements var- 
ied in length from syllables (sh-sh) or one word (a 
Pupil's name) to complex sentences. 
, Five judges and one of the investigators, work- 
ing independently of each other, classified a random 
Sample of teacher statements. Agreement among 
the judges resulted in 79. 1 percent agreement on 
role-taking processes and in 71.9 percent agree- 
ment on content categories. Three months later, 
the investigator repeated the classification of the 
Sample and obtained 94 percent agreement with the 
earlier classification. 

Teachers' Value Systems— A review of research 
URS on values, their measurement, their con- 
€nt, and their presence in the teac hing-learning 
Situation, indicated wide-spread usage of the Allport 
~Vernon-Lindzey Study of Values (2). Although re- 

É Viewers question the validity of the theoretical basis 
hs this test and although they point out certain sta- 
istical problems encountered in using a measure of 
relative strength rather than absolute degree of the 
Measurement of values, these reviewers do agree 
that this test is a dependable and informative in- 
Strument, Consequently, it was decidedto use this 
test to secure the necessary information onthe val- 
Чез held by the teachers in this sample studied. 
The Allport- Vernon-Lindzey Study of Values, 


based directly upon Edvard Spranger Types of Men 
( 8), considers the following dominant interests and 
ruth), 2) e- 


Motives: 1) theoretical (discovery of t 
ay nomic (utility), 3) aesthetic (form and harmony), 
) social (love of people), 5) political (power), and 
‚ Teligious (unity). Proceeding according to the 
rections in the manual (3), the Study of Values 
ale was administered to each 
Exploratory efforts in groupin 


ord 

tensive variability in the 
ing five values. In- 
the total value pat- 
d. Since the test- 
essitated 


i having 
f this study aS groups, 
8 š c 
iq Нау the same value profile, the groups were 


compar i 
the D functi 
independentl 


Glaser (12), : 
* 5 betweenthe various 


la for calculating 
ae for differ- 
i shape, 


b ile Statistic chosen for 
Ence 9Í the subjects was 
anq с Шеавцге, developed 
еч е (22), Cronbach and C 
Scores < Squared discrepancie 
D ig. S in the profiles. The for 
“tees D = 42. This measu 
Scatte in all three dimensions oft 
T e and elevation. 

Stope. D measure was compu 

Š for all possible pairs of sub, 


i lue 
ed from the six va d 
: jects. The D's 


thus obtained yielded a 50 x 50 matrix. Distribution 
of the 1,225 D statistics ranged in value from 3.87 
to 42.02. The mean of the distribution was 20. 26 
and the standard deviation was 6.58. The Ramify- 
ing Linkage and Group methods of clustering var- 
ables from an intercorrelation matrix as described 
by Cattell (9) was used to identify homogeneous 
clusters of subjects within the matrix. 

The size of the D selected as indicating а signif- 
icant relationship between profiles was the whole 
number 13 or approximately the D value of one 
standard deviation below the mean of the distribu- 
tion. Using the Ramifying Linkage m ethod of 
searching the matrix, closely interrelated, mutual- 
ly consistent triads and quads were identified by 
putting together the variables which had a D 
function of similar magnitude; t hu s forming nuclei 
of the most similar profiles. By assessing the o- 
verlapping one with the other, the approximate 
clusters were formed. If any variable repeated it- 
self in two-thirds or more of the small nuclei, it 
was retained in the cluster. The two-thirds cri- 
terion was an arbitrary cut-off point. 

Some variables seemed to be independent of the 
established clusters. By the method of visual in- 
spection, each variable was assigned tentatively to 
the group that the profile seemed to match. To test 
the warranty of including these independent vari- 
ables, the average D betweenand within groups was 
calculated. The relationship between groups 
seemed to be constant because this relationship did 
not change markedly when thetentatively assigned 
variables were dropped from the clusters. On the 
basis of these results, retaining these variables in 
the groups seemed justified. 

Ten of the independent variables were sufficient- 
ly unique to prevent their inclusioninany of the es- 
tablished groups. In fact, these ten variables were 
different to the degree that no two of them could be 
considered a group; therefore, they were dropped 
from the study. 

Thus, five groups representing different value 
patterns were established. An indication ofthe ho- 
mogeniety of each group was found by calculating 
the average D within the group; the relative inde- 
pendence of each group was assessed by calculating 
the average D between groups. These results indi- 
cated that the value patterns of the subjects in each 
of the groups were relatively homogeneous and that 
the groups were relatively inde pendent of one an- 
other. 

Figure 1 shows a comparison of the mean score 
profiles of the five groups on each of the six values 
The group having the highest mean on any of the 
values Was compared with the other group on that 
particular value to determine the degree of conti 
dence that could be placed inthe difference between 
these means. Significance of the mean difference 
was determined by the use of the t test. The vari. 
ance was calculated from the raw scores. Basin 
of the test of significance are presented in Table I 
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FIGURE | STUDY OF VALUES PROFILES 
FOR ALL GROUPS 


MEAN VALUE SCORES 
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These results showed that Group Iis distinguish- 
ed by its high Theoretical value; Group ПЬу the Re- 
ligious value; Group III by the Social value; Group 
IV by the Political value; and Group V by the Eco- 
nomic value. As indicated in Table I, these groups' 
means were significantly different from all other 
groups on the respective values except for the group 
With the next highest mean score on the particular 
value, 


Comparison of Teachers’ Value Systems and Verbal 
Behavior 
— s.—_—_SHÑa 


Through cluster analysis of the results yielded 
from the Allport- Vernon- Lindzey Study of Values 
Scale, five distinct groups of subjects were identi- 
fied. These results identified G roup I with a high 
Theoretical value, Group II with a Religious value, 
Group III with a Social value, GroupIV with a Polit- 
ical value and Group V with an Economic value. The 
verbal behavior of each of these groups was classi- 
fied according to role-taking processes and idea- 
tional content. The next step in this research was 
to test whether there was a differential in verbal 
Statements of the five groups of subjects. 

Through the use of chi square, it was determined 

hat the total frequencies of the verbal statements 
Or each of the five groups differed signific antly 
Tom each other at the . 001 level, that frequencies 
9f each of the role-taking processes differed signif- 
icantly from each other at the .05 level or less, and 
‘hat the feequencies of each of the content categor- 
tes differed significantly from each other at the .05 
evel or less. The . 05 level was accepted as indi- 
cating a significant difference in the frequencies. 
t The discovery of a significant difference among 
he frequencies of the five groups on each of the 
Ole~taking processes and content categories led to 
further analysis to determine where the differences 
a atd, This step was necessary and warrantedin 
er tot ecific hypo 

ese t dha ot reported in Tables II and III. 
As shown in Table II, differences 1n the results 
ot the evaluation of the Role-taking Processes were 


re P es, Group 
A -taking Processes, 
In Supportive Role g icantly from each 


of (Political value) differed signi 


© other groups. 
In Instructive Role-taking Processes, DRE 
of Political value) differed significan: Y 


etical value) dif- 
im Jena roope, Grow 1 ES (Social value), 


fro O Significantly from Group 

(Res Group IV (political value) and from GroupV 
з оше value). | ae 

Groy In Non-Supportive Role-taking Pr arenis 

val “р I (Theoretical value) and Group I ж 
4°) differed significantly from all other geom 

Groy In Problem Solving Role-taking proge € 

Valų P I (Theoretical value), Group п ( eres 

Cant ), and Group IV (Political value) were sig 

Y different from all other groups: 


As shown in Table III, the following differences 
in the results of the analysis of the content categor- 
ies were noted: 

1. Inthe content category subject matter, no 
group differed significantly from all other groups. 
Group I (Theoretical value) and Group IV (Political 
value) differed significantly from GroupII (Religious 
value), from Group III (Social value) and Group V 
(Economic value). In turn, Group V (Economic val- 
ue) differed significantly from Group I (Theoretical 
value) and Group IV (Political value). 

2. Inthe Content Category Standards of Achieve- 
ment, Group I (Theoretical value) and Group III 
(Social value) differed significantly from all other 
groups and from each other. Group П (Religious 
value) and Group V (Economic value) differed sig- 
nificantly from all other groups except Group IV 
(Political value). Group IV (Political value) differ- 
ed significantly from Group I(Theoretical value) and 
Group V (Economic value). 

3. Inthe Content Category School Rules and 
Regulations, Group I (Theoretical value) and Group 
IV (Political value) differed significantly from each 
of the other groups and from each other at the . 001 
level. Group II (Religious value) and Group III (So- 
cial value) differed significantly from all other 
groups except Group V (Economic value). In turn, 
Group V (Economic value) differed significantly 
from Group I (Theoretical value) and Group IV (Po- 
litical value). 

4. Inthe Content Category Social Expectations, 
Group I (Theoretical value) and Group IV (Political 
value) differed significantly from each of the other 
groups and from each other at the . 001 level. 

These data were used to test the specific hypoth- 


eses of this study. 


Findings of the Study 


Teachers whose values are characterized by a 
high Religious value (Group II) tend to make more 
supportive statements thanteachers whose value 
systems are characterized by a high Political value 
(Group IV). The statistical data supportthis hy- 
pothesis at the . 001 level of significance. 

These two groups, that is, Group I and Group 
IV, differentiated themselves to a statistically sig- 
nificant degree on the Religious value scale but not 
on the Political value scale. As such, any manifest 
verbal behavior difference between the groups might 
be a function of the difference in Religious value 
pattern rather than the Political value pattern. 

Teachers whose value systems are character- 
ized by a high Social value (Group HD tend to em- 
phasize social expectations to a greater extent than 
teachers whose value systems are characterized by 
a high Political value (Group IV). The statistical 
data support this hypothesis atthe .001 level of sig- 
nificance. 

Group II (Religious), although not significantly 
different from Group IV (Political) on the Political 
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TABLE II 


EVALUATION OF DIFFERENCES IN ROLE-TAKING PROCESSES FOR ALL GROUPS 


B--Instructive 


Group A--Supportive 

I II Ш IV V I Ir ш IV V 
I - NS NS <.001 NS - NS «.001 <.001 <. 001 
п - <.001 NS - NS <.001 NS 
HI - <.001 NS - <. 001 NS 
IV - <. 001 - <. 001 
— рте solving | 
I - <.001 <.001 <.001 <.001 - <.001 <.001 <.05 <.001 
II - <.001 <.001 <. 001 - <.001 <.05  «.001 
IH з NS <. 05 - <. 001 NS 
IV - NS - «.001 
у - а 

ТАВІЕ Ш 


EVALUATION ОЕ DI 


FFERENCES IN CONTENT CATEGORIES F 


OR ALL GROUPS 


II--Standards of Achievement 
I II ш IV У 


- <,001 <.05 <.001 <. 001 


- <. 001 NS <.01 


NS <.01 


IV--Social Expectations 


Group I--Subject Matter 
I II ш IV V 

I . <.001 <.001 NS <.001 

II - NS <.01 NS 

ш z 08 NS 

IV - <.01 

: m 
III- -School Rules and Regulations 

I «.001 <.001 «4.001 «.001 š 

I ZO ES 001 NS 

ш 5 <.01 NS 

IV <.001 

V - 


<.001 <.001 <.001 <. 001 


= NS <. 001 NS 
- <. 001 NS 
= <.001 
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value scale did not emphasize social expectations to 
any greater degree than Group III (Social). There- 
fore, the verbal behavior d ifference noted between 
Group III (Social) and Group IV (Political) might be 
a function of the disparity inthe Social value pattern 
rather than the disparity in the Political value pat- 
tern. 

T whose value systems have a high Polit- 
ical value (Group IV) tend to make more non-sup- 
portive statements than teachers whose value sys- 
tems are characterized by a high Religious value 
(Group H). This hypothesis is supported by the data 
at the . 001 level of significance. 

The results of this study failed to support hypo- 
theses Number 2 and Number 3. 

Teachers whose value systems show a high pre- 
ference for Economic value (Group V) do not tend to 
emphasize school rules and regulations to a signif- 
icantly greater extent than teachers whose value 
systems are characterized by a high Social value 
(Group III. The statistical data do not support this 
hypothesis. 

Teachers whose value systems have ahigh Theo- 
retical value score (Group I) do not tend to use the 
problem solving approach to a significantly greater 
extent than teachers who have a high Aesthetic val- 
ue. 

Since the highest Aesthetic value was Group I's 
(Theoretical) second highest mean score on its val- 
ue profile, hypothesis Number 3 was not testable. 
No group of teachers had the Aesthetic value as its 
highest mean score. 

In addition to testing the hy potheses , the five 
groups were compared according to the most sig- 
nificantly high and low mean response. Although 
the test of significance was chi square , the mean 
response of groups was used for desc ribing the 
role-taking processes and content categories. 

The evidence seemed to indicate that the five 
groups exhibited the greatest differential inre- 
sponse on problem solving roles; next, from highto 
low, on non-supportive roles, standardsof achieve- 
ment, and school rules and regulations. Less dif- 
ferential in response was observed in supportive 
roles, instructive roles, and subject matter state- 
ments. 

The general results of this study revealed dif- 
ferences in verbal behavior and value systems of the 
teachers observed. The predicted differences in 
verbal behavior relative to different value systems 
were supported to a significant degree by the data 
in three of the five sub-hypotheses made in this 
study. Further research is suggestedto investigate 
the factors which influence these differences. 


Critique of the Study 


1. The sample of teachers included inthis study 
is not representative of teachers in general. The 
size of the sample imposes limitations on thegen- 
eralizations which can be made from these results. 


2. The sample was decreased insize by the loss 
of ten teachers, whose value patterns were Be 
to the degree that their value profiles did not m = 
any of the established groups’ profiles or each ot | А 
It is possible for one to speculate that the samp : 
was too small to permit the inclusion of these ri 
teachers or that their value patterns are unique Н 
the degree that they can be assessed only on an 1n 
dividual basis. м 

3. Even though three of the five hypotheses we а 
supported by statistical evidence, the results rgo 
be less tenable because one of the groups used bes 
comparison in each of the supported hypotheses n 
Group IV (Political value), composed of three [у 
ers. However, оп non-supportive role-taking ee 
cesses, Group IV’s mean response was not wes 
cantly different from Group III (Social value), ecd 
posed of eight teachers, or from Group V (Econ 
ic value), composed of eleven teachers. — ifis 

4. Another consideration is the sign if ic pene 
high mean response of Group I (Theoretical va 
and the significantly low mean response of o usa 
(Political value) on total statements. One mig^ Үз 
sume that whenever the above relationship арр i 
їп а particular role-taking process or content a tos 
gory, it is a reflection of the highest and Lp ose" 
tal frequencies of these two groups. While ries 
are role-taking processes and content catego po 
where this relationship was exhibited, there cbe °, 
ceptions; for example, in the problem solving 
Group I had the lowest mean response. 

5. Inherent in content analysis are the 1 
tions involved in constructing accurate catego 2 
and defining processes. Some ofthe categorie i 
role-taking processes, such as school rules 
regulations and problem solving roles, do se 5 
reveal general significance, but others gend the 
definitive. Although the reliability test о ween 
framework showed fairly high agr eem ent better" 
the judges and investigator, these observed pem 
ences point to the need for refinement of the $C 
for classifying teachers' statements. 
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THE TEACHER’S ROLE IN LIBRARY SERVICE 


SAAD M. EL-HAGRASY 
Rutgers, The State University 


LIBRARY PROVISION in elementary schools is 
an essential part of the educational process. **What- 
ever form the soul-searching regarding the educa- 
tion of youth may take, sooner or later it has to 
reckon with the adequacy of the library resources in 
the school... 'l* This statement from Standards for 
School Library Programs indicates that “The wide 
and diversified use made of books and other mater- 
ials by students comes largely from creative, stim- 
ulating teaching and individualized instruction that 
£0 beyond the limited confines of textbooks... Class- 
room instruction of this nature depends on teachers 
Who know books andother materials appropriate for 
the children or young people with whom they are 
Working. „2 

. In any situation where library service is pro- 
Vided for elementary pupils, whether by the public 
library, the school library, the central collection or 
the classroom collection, the role of the elementary 
teacher is assumed to be important, an assumption 

ased in the past primarily on opinion and profes- 
Sional judgment. It is possible to argue about, or 
at least to be indifferent to, the importance of the 
teacher’s role in library service as long as there 
is not concrete evidence of such importance. To ob- 

Rin such concrete evidence was the starting point 


9f the 
prenent аш r 1960-61 an investigation 


1s inNewark, New Jersey, 
of the teacher’s role in li- 


a Ine the im portance 0 
the Statistical basis. In order to 
E main procedures, conclusions, 
E investigation, three basic S 
аге dealt with in the article: D th 
d 3) findings. | a 
ro Ina study aimed to investigate the = te 
ae in library service, it was necessary first a Be 
de on specific criteria by which this role cot dp 
®asured, Different types of criteria are use bine 
tig Suring the effectiveness of the teacher ss on 
to the education of pupils. “Notwiths or 
inclusiveness of current conceptions of teaching, 


* 
F = 
Stnotes will be found at end of article. 


there is one assertion upon which virtually every 
one is in accord. It is universally agreed that ef- 
fective teachers are primarily those who contribute 
to the growth of the pupil. 24 As to the present in- 
vestigation, two main criteria from the field of pu- 
pil growth were decided on as pertinent measure- 
ments of the teacher's role in library service: 
1) amount and kind of pupils’ reading, and 2) pupils’ 
library skills. 

Second, it was necessary to choose certain 
teacher behaviors that contribute effectively to the 
two criteria mentioned above. Two pertinent types 
of behavior were decided on as appropriate predic- 
tors for the teacher’srole in library service: 1) the 
teacher’s reading habits, and 2) the teacher’s li- 
brary background. Having established the aim, the 
criteria, and the predictors, the hypothesis of the 
present investigation reads as follows: There should 
be a measurable relationship between the teacher’s 
reading habits and library backgrounds (as predic- 
tors) and the pupils’ reading and library skills (as 
criteria). 

Third, it was necessary to establish the ration- 
ale of the hypothesis statedabove. The rationale is 
based on four premises: 1) Teacher behavior is ob- 
servable and measurable; 2) pupil gain is observ- 
able and measurable; 3) teacher behavior concern- 
ing library service affects pupil gain from this ser- 
vice, and 4) the specific teacher behaviors in the 
predictors affect the specific pupil gains in the 
criteria. 

The first premise is supported by the assump- 
tions on the basis of which research in teacher be- 
havior is established. Ryans discussedand verified 
the basic assumptions for such research. 5 The 
second premise is supported by the fact that educa- 
tors have been able to develop devices by which the 
pupil gains are fairly measured. 6 The third premise 
is supported by the pr ofessional judgment given 
earlier in this article concerning the teacher’s role 
in library service.’ Thefourth premise is support- 
ed by (besides the first three premises) the fact 
that, in both predictors and criteria, there are two 
constant elements, that is, reading and library back. 
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d. А 
„> making a survey of the pertinent literature, 


it was concluded that the present investigation is new 
in its aim and hypothesis, though some of its ele- 
ments were dealt with in one way or another in pre- 
vious studies. It was also decided that the present 
investigation could profitably adapt some measures 
established earlier in three appropriate studies. 
The Rutgers Study of 1960 (Phase I) had as its main 
predictor the existence of a “centralized library at 
the elementary level.’’8 However, the investigators 
of the Rutgers Study set up, duringtheir work, use- 
ful criteria among which are: 1) the degree of mas- 
tery of library skills (on pupils' part); 2) the amount 
and kind of reading done by children, and 3) the ex- 
tent of library-related activities іп the school. It 
was found that 1) and 2) could be properly used, with 
a very slight change, as criteria for the present in- 
vestigation. As to 3), it was found that, with due 
changes, the activities list could be used as a part 
of the present study's predictors. Inastudy designed 
to investigate school library services as they are 
viewed by secondary-school teachers, the Research 
Divisionofthe N.E.A. introduced many data-gather- 
ing devices. 9 From this inquiry a single question 
related to the teacher’s library background was found 
to be pertinent for inclusion in the present study’s 
predictors. After a comprehensive investigation of 
the literature on reading and through agood number 
of case-studies of three groups of readers, Gray 
and Rogers developed in 1956 an intensive and up- 
to-date device for measuring reading in its broad 
meaning. 10 Jt was found that their device could 
serve as a basis for anew device for measuring 
teacher’s reading habits (the remaining part of the 
present study’s predictors). These are the three 
studies from whichthe present investigation adapted 
the measures mentioned above, 

The research field consisted of two elementary 
Schools inNewark. In addition, ten other schools in 
Newark and other towns in New Jersey provided the 
try-out field. In the two experimental schools the 
actual investigation was confined to the sixth-grade 
classes (four in each school) and their fourth-, fifth-, 
and sixth-grade teachers. The hypothesis of the 
study was tested by examining the relationship be- 
tween the eight classes' reading and library skills 
(the criteria) andthe reading habits and library back- 
grounds of their present (in sixth grade) teachers 
(the predictors). 

As stated above, the hypothesis aims to test the 
relationship of the criterion factors (pupils! reading 
and library skills) to the prediction factors (teach- 
ers' reading and library backgrounds). If these two 
aspects were to exist alone by themselves, the in- 
vestigation would be more than easy; they are, how- 
ever, contaminatedby other factors in the research 
field, identified as the contamination factors, The 
contaminatives are illustrated by the following ex- 
amples from the actual scene of the research field. 
If ateacher had hada course in children's literature, 


it might be predicted that his pupils would read gore 
and better than other pupils without such a teacher. 
But these other pupils might have come from better 
homes that have an abundance of well-selected chil- 
dren’s books. Or, giving another example, if a 
teacher has taken more responsibility in ene 
and training his pupils in library skills, it might a 
predicted that his pupils would be more libr ary: 
skilled than the other pupils without such a psg гав. 
But it might be that his pupils have lower I. Q. dem 
the other pupils, or their previous teachers di wo 
take enough responsibility to teach them and rne 
them in library skills; or the other pupils might e 
had a better school, a better library, or a better 3 
brarian. These examples have two purposes: to 
plain the complexity of the problem, and to sugg 
the appropriate way for research control. -— 
The real task of the investigator was to S Mi 
the research situation carefully, and 1)to aonik 
all factors and elements that make up the probier 
(criteria, predictors, and contaminatives), 2) p Ti 
tain the pertinent data about them, and 3) to ape 
hypothesis on this tri-partite basis. As to e гав 
teria andthe predictors, they were decided on à иа 
very beginning of the investigation. In ВИШЕ 
contaminatives, four areas were decided on ae 
portant sources of contamination for the inven pies 
tion: a) community variables, b) school — 
(excluding teachers), c) previous teachers, zA à 
pupils’ backgrounds. The community variab A 
studied were traditions, economic و‎ ia Ë 
cultural features. The school variables b) inclu 


acil- 
characteristics of the student body, staff and fac 


۴ ata 
ities, including the librarian and the library. Т on 
on previous teachers (c) consisted of their ё abits 


the pupils measured by the teachers’ reading ai 
and library backgrounds. Data on pupils’ 2? and 
grounds (d) included I. Q., parents’ occupation, 
parents’ education. 

Having identified the three types О 
mentioned above (criteria, predictors, and t dai 
inatives), it was necessary to obtain perii a ex- 
by whichthey might be measured. Since the th inde- 
perimental schools, A and C, were dealt ka i 
pendently from each other, it was assume oa af- 
community and school factors (see vove) T py the 
fect the pupils’ reading and library skil ü the 
same amount in a given school. Consequen Yer 
data relatingtothe community andto the schoo 
presented for identification purposes only. red by 

All other data were collected and pc aai 
sevendevices: three (Devices 1,2, and 3)for upi 
ers’ data, and four (Devices 4,5, 6, and 7) for P pout 
data. Device 1 was designed to collect aa اون‎ 
the following aspects in teachers’ reading: pt ary 
asm for reading, amount of time spent on VO gep 
reading, breadth of interest, reading mediti a st 
of interest, number of books read in the one і read” 
area, purposesfor reading, value of purposes» once? 
ing difficulty of the material read, and the a ol 
in the material read. Device 2 was designed 
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lect data about the following elements in the teach- 
er’s library backgrounds: library experiences dur- 
ing school years (in elementary, secondary, and 
college education), up-to-dateness of professional 
preparation, and amount of library education in pro- 
fessional preparation. Device 3 was designed to 
collect data about the teacher's library activities in 
the school. For the 125 activities of Device 3, the 
respondent's opinion was obtained concerning the 
€ssentiality of the activities and the distribution of 
responsibility between the teacher andthe librarian. 
Activities tested are those related to the reading 
Program and library instruction of the school. 
Devices 4,5, and 6 were used to collect data 
about the pupils’ reading andlibrary skills. Device 
4, through a reading record called “Му Reading 
Notebook’ and for a seven-week period, provided 
the following data: number of books read, number of 
literary forms, number of interest areas, reading 
diffic ulty, conceptual level, enjoyment, sources, 
Number of magazines, frequency of magazines read, 
and number of comics read. Device 5, through a 
Questionnaire administered to the pupils at the end 
9f the recording period, provided the following data 
about pupils' reading: number of purposes, and num- 
ber of stated interests. Device 6, through an eighty- 
Question test administered tothe pupils at the end of 
© recording period, measured the pupils library 
Skills. Device 7 was used to obtain the following 
data: the last I. Q. scoreson the cumulative records 
Of the pupils; the bread-winner's occupation classi- 
fied (in desce nding order) as: professional, pro- 
Prietors and managers, business men, clerks, ma 
àl workers protective and service workers, an 
armers; and the bread-winner’s education capsi 
164 as: post-graduate, college, highschool, an 
Brade school, 
бек For each device, thr 
i tained: the appropriatene 
€ present investigation, t 


lon of th i its items 
e device and its i s а 
Problem or its use. It was necessary to obtain ob 


lective esented in statisti- 
da have them pr : : 
m form S oreliminary step forthe final апау 
Ма we py using the mean and the 
ыча jat analyzedbi ya differences were esti- 
€viation: the significant 91116 ne mean 
ed on the basis of the deviation from í 
K more or less than one standard dewislen, n 
the ficant at the 15 percent level or beyond. 


: i it was as- 
Ti i i onedearlier, i 
Su partite analysis menti he investigation would 
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ace of Was employed in the eight sixth-grade ооа А 
lis n) the two exper imental schools (se 


ee main aspects Were as- 
ssof the device for use 
he statistical construc- 
in detail, and the 


Findings—Two teachers (one in School A and one 
in School C) were significantly low on reading and 
library backgrounds; noteacher was significant- 
ly high. Five teachers (three in School A and two in 
School C) were relatively high on reading and library 
backgrounds; one teacher (in School C) was rela- 
tively low. 

For the two classes (4 and 8 in Tables I and II) 
of the two significantly low teachers, the scores on 
pupils’ reading and library skills are significantly 
low; the contam ination factors (effect of previous 
teachers and pupils’ backgrounds) are not signifi- 
cantly against these two teachers. As a matter of 
fact, the larger part of the contamination factors are 
intheir favor. Therefore, the hypothesis is sub- 
stantiated. 

For the five classes (1,2,3,5, and 7 in Tables 
I and II) of the five relatively high teachers, the 
Scores on pupils' reading and library skills are as 
follows: 

a. Class 7 is significantly high; no contamina- 
tion factors are significantly in favor of the 
teacher. As a matter of fact, the contamin- 
ationfactors areagainstthe teacher. There- 
fore, the hypothesis is substantiated. 

b. Classes 2 and 3 arerelatively high (however, 
the highest in the school); no contamination 
factors are significantly infavor of the teach- 
ers. Аз а matter of fact, most contamina- 
tion factors are relatively against them. 
Should the relative deviation (not at 15 per- 
cent level) be accepted, the hypothesis is al- 
so substantiated for these two classes. 

c. Class 1 is very slightly under the mean; how- 
ever, the unusual situationofthis class might 
have contaminated its score on pupils’ read- 
ing and library skills. Class 1 consisted of 
ten sixth graders seated in a seventh-grade 
class. It might be that the curricular as- 
signments for sixth graders studying among 
seventh graders аге so heavy that the ten pu- 
pils could not pay enough attention to the vol- 
untary project of the investigation. At any 
rate, the scores of this class on both predic- 
tors and criteria deviate from the mean only 
relatively; so, there is no significant result 
against the hypothesis. 

d. Class 5 is relatively low (however, not the 
lowest in the school), but a very important 
factor of contamination is against the teach- 
er. Class 5 is one of two classes in the 
schooldevotedtothelower pupils in terms of 
achievement tests. Thisfact is supported by 
comparing the mean L Q. score of Class 5 
(113. 1) to that of Class 6 (124, 8). At any 
rate, the scores of Class 5 on both predic- 
tors and criteria deviate from the mean only 
relatively; so, there is no significant finding 
against the hypothesis. 


For the class (6 in Table II) of the relatively low 
teacher, the scores on pupils' reading and library 
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TABLE III 


SCHOOLS A and C 


TESTING THE HYPOTHESIS OF THE STUDY BY COMPARING THE SCORES ON 
THE DATA PRESENTED BY CATEGORIES IN THE EIGHT 
SIXTH-GRADE CLASSES 


Present 
Teacher's Pupils' Pupils' Other 
Classes R and L R and LS I. Q. Contaminatives 
School A 
1, 2, and 3* U: dê 11.3 ** s5 
4 22 8 жж Hts 
School C 
5 and 7* U:5 13 113. 7 БЫ 
бапа 8* 1:1 10 123. 8 uii 


* All scores are presented in terms of the mean 
**The difference is too limited to be of any value 


RandL = Reading habits and library backgrounds 
Rand LS = Reading and library skills 

U = From the upper group of teachers 

L = From the lower group of teachers 


TABLE IV 


LIBRARIANS 


COMPARISON CONCERNING “125 LIBRARY ACTIVITIES" BETWEEN PART-TIME 
AND FULL-TIME LIBRARIANS IN ELEMENTARY SCHOOLS 


Not Teacher's Librarian's Final 
Time School Essential Responses Responses Score 
Part (The Three)* 13. 8% 15.3% 10. 9% 68.2 
iem A 9.6% 11.2% 79.2% 78 
puli (The Three)* 12. 9% 27.8% 60.3% 59.5 
Full e 12. 8% 32.8% 54.4% 54. 


*The figures presented аге the means. 


EL-HAGRASY 25s 


Skills is relatively high (however, not the highest in 
the school); all contamination factors (twoof them 
Significant) are infavor of the teacher. Also, Class 
6is devoted by the school to the upper pupils in 
terms of the achievement tests. At any rate, the 
Scores of this class on both predictors and criteria 
deviate from the mean only relatively; so, there is 
no significant finding against the hypothesis. 
. The findings presented above are based on test- 
ing the hypothesis in the individuals classes (class 
by class). The hypothesis was also tested collec- 
tively by comparing the upper group of teachers in 
One set to the lower groupof teachers in another set 
(see Table Ш). In School A, the three upper teach- 
ers and their classes are com par ed to the lower 
teacher and his class; in School C, the two upper 
teachers and their classes are compared to the two 
lower teachers and their classes. In both schools, 
the mean scores of the upper teachers’ classes on 
Pupils’ reading and library skills are higher than 
those of the lower teachers’ classes; the contamin- 
ation factors are not in favor of the upper teachers. 
To sum up, the hypothesis that there is a meas- 
rable relationship betweenteacher's reading habits 
and library backgrounds (as predictors) and pupils 
reading and library skills (as criteria), when tested 
У the individual method is substantiated as a posi- 


tive relationship for this sample, that is, a) when a 
d library backgrounds 


then his class's 
so significantly 
when a class's reading 
y high (Class 7), 
nd library back- 
relatively high. 


med up above, 


teme i ts for both education and 
КЫ, y BVI p crum ied. One of the interest- 


(full ^ 
ic l-time or part-time) and t ens 
: Villing to Varia ipate in the library i aeqne 
re full-time librarian would be willing to 


° i i i ian. Оп the 
Conf sibility than the part-time A (part-time) 
en, ТАТУ, the librarian o аге 


Er is willing to tak 
lps ed that she is willing 
a ibrary activities of Device 3 above while UE 
onp rian of School C (full-time) checked ent 
Outa. This interesting case was suppor tec ү 
lib Come of the same device filled out by six ther 
tim arians in Newark elementary schools: gra 
thag? and three part-time (see Table IV). I 2 um 
but; the librarians are not affected, in their dis ч 
°" Of the responsibility for library activities, y 


the amount of time available for them in the school. 
It might be that some psychological reasons stand 
behind the librarians’ distribution. Worried about 
their status inthe school, part-time librarians might 
think of taking more responsibility (in quantity) to 
prove that they are an important part of the educa- 
tional process in the school. Onthe other hand, full- 
time librarians, not so much worried about their 
status in the school as about thequality of perform- 
ance, might think of taking less responsibility and 
doing a better job. At any rate, this unexpected 
finding is just one example to show that the field of 
of library service has many aspects that need more 
research and investigation. 

Going back to the main findings of the present 
investigation, it should be recalled that the aim of 
the study was to prove andto estimate the importance 
of the teacher's role in library service on an em- 
pirical and statistical basis. The implications of 
the findings are of significance in both education and 
library service. It shouldbe remembered, however, 
that the findings are based on the investigation of 
only two elementary schools ina single education 
system of one state. So, whatever significance may 
be attributed to these findings, it is still needed to 
support them by more sample investigations of the 
same problem. The investigators should be encour- 
aged in spiteofthe fact that there are many positive 
indications that the hypothesis will be substantiated 
in future investigations. Furthermore, a reading of 
the original study will suggest other related studies. 
For example, more investigation of the role of the 
full-time and part-time librarian may clarify the ex- 
tent and nature of responsibilities in each case on 
the part of the teacher and thelibrarian. Other im- 
portant implications of the main findings in the pres- 


ent investigation are: 


1. Teacher education programs— For a long time 
educators and experts of library service advocated 
the inclusion of library education as an essential 
part of professional preparation of teachers. 11 The 
findings of the present study provide corroboration, 
within the limited sample, for the necessity of li- 
brary education and stronginterests in reading as a 
definite part of professional preparation. It is per- 
tinent to mention here that preparation of teachers 
became recently so acute a problem that it was in- 
vestigated in a study published by Harvard Univer- 
sity Press. In this new study, teachers' inter- 
ests in reading and library backgrounds (the two 
predictors of the present investigation) were not ex- 
plicitly covered. Therefore, theimplications of the 
present findings deserve due consideration in addi- 
tion to the twenty-two recommendations listed at the 
end of the Harvard Study. 

2. Teaching efficiency — For supervisors and 
other educators who are responsible for evaluation 
of theteacher's work with pupils, this study has sig- 
nificance. For example, the evalnator may use the 
criteria of the investigation (pupils’ reading and li- 
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prary skills) or some of their basic elements as a 
tentative yardstick by which the teacher’s work can 
pe estimated. By the same token, those teachers 
who are interested in well-balanced teaching activi- 
ties can recognize that effective library service of- 
fered to pupils is an indispensable part of their 
duties. 

3. In-service training—For supervisors, ad- 
ministrators, and librarians who are responsible 
for planning and carrying out or may participate in 
programs of in-service training for teachers already 
on the job, the present investigation provides one 
area of training which should not be overlooked. For 
example, in Schools A and C, only 11 percent of the 
teachers hadtakena separate course in library ser- 
vice as a part of their professional preparation. 13 
There is no reason to believe that other schools are 
better than these two schools; the N. E. A. inquiry of 
1958 reports that only 12 percent of secondary teach- 
ers had taken a separate course in library service. 14 
If the predictor of the teacher’s library backgrounds 
is significant for the teacher’s role in library ser- 
vice, then there is an urgent need for library-ori- 
ented programs of in-service training for more than 
60 percent (70 percent according to the N. E. A. in- 
quiry) of the teachers whose professional prepara- 
tion did not include any library education or whose 
library education was only incidental. 

4. Schoollibrary standards— The school stand- 
ards of 1960 did not forget to emphasize the teach- 
er's roleinlibrary service. 19 The findings report- 
ed here underscorethe importance of this emphasis. 

5. Schoollibrary service—School librarians no 
doubt recognizethat, withthe same good library and 
librarian, it is possible to get opposite results in 
pupil outcomes, depending on the amount of teacher 
participation in library service to pupils. It should 
be noted that in School C, whose library and librar- 
ian are better than the average, one class (8 in Ta- 
ble II) of upper IQ pupils was significantly low in its 
Score on reading and library skills, while another 
class (Tin Table П) of low IQ pupils was significantly 
high in its reading and library skills. The key ex- 
planation of this paradoxical case could not be the 
library or the librarian, sincethey are the same for 
both classes. According to the present analysis, it 
was the teacher's role in library service which dif- 
ferentiated thetwo classes. The first class's teach- 
er was significantly low in his reading and library 
backgrounds while the other teacher was relatively 
high in both factors. Thisimpliesthata good teach- 
er (in reading andlibrary backgrounds) may not only 
compensate for the low IQ of pupils but he may also 
provide his lower IQ pupils with some opportunity to 
raise their scores on reading and library skills. 

Summary—The study began in the theoretical 
plane as a reasonable hypothesis; the literature pro- 
vided some pertinent measures which could be prof- 
itably adapted later on during the investigation. In 
the design plane, the study went through logical steps: 
identification of thefactors involved in the problem, 


obtaining the pertinent data on those factors, and 
finally testing the hypothesis on the basis of ie 
partite analysis. In the findings plane, the hypoth- 
esis was substantiated for the sample, with some 
promising implications in both education and libr ary 
service, and with a hope for further investigations. 
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FEEDBACK IN CLASSROOMS: A STUDY OF 
CORRECTIVE TEACHER RESPONSES 


MORTON D. WAIMON 
Illinois State Normal University 


THE EFFORTS described in this paper grewout 
Of an attempt to help prospective teachers study and 
understand inter-action in classrooms, and to help 
them become more aware of pupil behavior in class- 
rooms, and more sensitive toits meaning for teach- 
ers. It was felt that this could best be done by 
Studying the teaching-learning process in actual 
classrooms, A method was developed, therefore , 
for describing, analyzing and interpreting observed 
Classroom behavior. * 

Basic to this observation of the teaching-learning 
Process is the conceptualization of the classroom as 
an action system; that is, aphenomenon whose sep- 
arate elements exist in dynamic relationship to one 
another and to the environment in which they are 
found, The model developed for this work depicts 


three ele in the classroom action system: the 
teacher, The learners and the behavior or class- 
demonstrate that a 


he behavior setting 


“nd the behavior of learners; 
àvior has an effect on the be 


ting itself limits the behavio 
earners, e words, the three elements are 
Mutually dependent each upon the others. — | 
Although the education students involved in this 
Investigation of the classroom studied the total ac- 
lon system, this paper is chiefly concerned with 
© way in which teachers are influenced by pupil 


fects teacher behavior 
s a question. Less ob- 
ter importance, all the 
the teacher with infor- 


The learner obviously af 
vig he Solicits help or ask 
взш pe perhaps of grea 
s i rovi t l 

ation DU Heel relative to that learning quod 
lon. He provides the teacher with clues about his 
Present readiness to learn. This in Poria di 
is ich is in the nature of a feedback to ine teams 
ty hat prompts a teacher to change or modify S пе 
‘Ng in the situation so that learning can occur. 


* 
Waimon, Morton D., ‘‘Observin 
P. 466-470 (December 1961). 


g the Classroom Action 


When a teacher perceives thatlearningis not taking 
place, he makes corrective responses by changing 
something in thelearning environment or by attempt- 
ing to change some aspect of thelearner's readiness. 
If we think of learning as occurring when learner's 
readiness and environment are brought into harmony, 
then we may view a teacher's corrective responses 
as maximizing the balance inthe teaching -learning 
system. 

This, then, is the conceptual framework which 
led us to ask the following questions: 


1. What proportion of teacher behavior is 
corrective; that is, is made in response 
to pupil behavior which indicatesthat 
learning is not taking place? 

2. What proportion of teachers' corrective 
responses is directed toward changing 
the environment? 

3. What proportion of teachers' corrective 
responses is directed to wa rd changing 
some aspect of the learner's readiness? 

4. Which aspect ofthe environment is most 
frequently manipulated? 

5. Which aspect of the learner's readiness 
is most frequently manipulated? 


Procedures 
2S 


After an initial orientation and training period, 
teams of four members each were established to 
make classroom observations, and observation 
guides were distributed to each team. One member 
was to concentrate and record data on the teacher 
two were to concentrate on the learners, the fourth 
on the behavior setting. Timesheets blocked off in 
five-minute intervals were used for recording, and 
an entire observation period lasted thirty minutes , 
Immediately following the observation period, team 


members coalesced their data. 
Teams were responsible for recording every- 


system, ” Journal of Teacher Education, ХП , 
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thing which took place during an observation period. 
Working as teams and having each member concen- 
trate on one elementof the action system helped in 
making the recorded accounts more complete and 
more accurate. The member responsible for the 
behavior setting had to identify the kind of lesson, 
unit or activity engaged in; the apparent goals and 
sub-goals of the activity; the selection and organi- 
zation of content; and the procedures followed, in- 
cluding the materials and equipment available for 
use. The member responsible for the teacher was 
to record everything the teacher said to an individ- 
ual learner or to the class; all the teacher's non- 
verbal behavior relative to an individual learner 
or tothe class; all the teacher's appar- 
ent feelings relative to an individual learner or to 
the class. The other two members divided the class 
between them to make observation easier, and were 
to record everything any learner said to the teacher 
or to the class; all significant non-verbal behavior 
of learners (that is, all behavior which was notice- 
able to the teacher and to the observers), and all 
apparent feelings expressed by any learner. At the 
end of the observation period, team members com- 
bined their records intoa running account of every- 
thing that happened during the observation period. 
Observations were made in nineteen classes of the 
Laboratory School of Illinois State Normal Univer- 
sity. 

Treatment of the Descriptive Data. The de- 
scriptive records gathered by the teams were di- 
vided into smaller units of behavior which were 
called behavior episodes. Behavior episodes may 
best be explained as samples of behavior,within 
the larger stream of behavior, which have a dis- 
cernible beginning and end. For example, during 
an arithmetic lesson a pupil discovers he has no 
pencil; he tries to borrow one from his neighbor 
without success; he informs the teacher of his dif- 
ficulty; is told to take one from the teacher's desk; 
he does so and returns tohis seatto continue work. 
All the action aimed at securing a pencil is abehav- 
jor episode. 

Classifying the Data. Team members then ana- 
lyzed and classified theirdata several ways. First 
the records were read over to find pupil behavior, 
both verbal and non-verbal, which indicated that 
the pupil was not ready to learn in that situation. 
Each such response was starred. Expressions of 
boredom, disinterest or confusion, inattention, ir- 
relevant behavior, questions regarding procedures 
or content were regarded as indications that a 
learner was not ready to learn; that is, not ready 
to make the correct response called for. Next the 
records were checked for teacher behavior which 
was made in response to starred pupil behavior. 
An “X” was placed beside each such teacher 
response. 

Behavior episodes were then classified into 
three categories: Type A episodes are those epi- 


sodes in which there was no evidence that any learn 
er lacked readiness tolearninthat situation. poeni 
ing proceeded smoothly without any apparent am s 
ing. Type B episodes are those episodes in whic | | 
learner indicated a lack of readiness to learn, О 
in which the teacher didnot respond to that specific 
pupil behavior. TypeC episodes are those eae 
in which a learner indicated a lack of readiness 
learn and in which the teacher responded to the spe- 
cific pupil behavior. 5. 

Type С episodes were further evaluated to iene 
mine how often teachers responded to pupils lac its 
readiness by attempting to change something in a 
environment, and how often the teacher’s respon 
tended ıo be directed toward the pupil himself. - 

When a teacher response was directed toward E 
environment, it was further classified into ESPO 
es that change the goal, responses that change ots, 
content, or responses that change the pred е 

When a teacher response was directed towar ba 
learner, it was further classified into ria 
that act on the pupil's equipment (that is, paeem e 
physique, sense organs or mental атина, to. 
sponses that act on pupil's needs and goals ( uate 
his need for affection, approval, independence, 55 
respect, or his immediate personal goals), oF 
sponses that act on the pupil’s learned ideas 
skills (that is, his previous learnings). 


The following are examples of each type episode: 


z ive 
Type A — (All pupils ready. No correct 
teacher responses made. ) 


DJ 
T: **What is the first number? Lynn? 
Lynn: “Three.” 
T: “Three what?” 
Lynn: “Three tens. ” 
qu “What does the 2 mean?’’ 
Lynn: “Two ones." 7 2 
"E: “And what is the whole number ' 
Three?” 
Lynn: “Tens. ” 
T: "САНЯ DWG. su sus PUT 
Lynn: ‘‘Ones. ” 
T “Make?” 


Lynn: “Thirty-two. ” 
T: “Good for you, Lynn.’ 


Type B — (Lack of readiness shown, but nO e 
rective responses made by teache 
ji ( reviewing spelling words)“ E v ££ 
Look at your own paper. If you ells 
at someone else’s paper that ү it: 
me you don’t know how to spel 
Begin, yesterday,....” peing 
Ricky: (Repeats all words without 
asked. ) ) * 
Scott, Jim, Brad: (Talked to each other: | 
Kerry: (Dropped his pencil; picked it YP 


Type С — ( 


Polly: 
T: 
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(Opened his book before he was 
supposed ќо.) 

“I got scared last night. "' 

*My mommy made some popcorn 
balls for Hallowe'en. "' * 

«Тһе last wordisinvite. All right, 
there are your words. Openyour 
book to page 80 and check your 
words, and I will come around to 
see if youare a good checker- 


upper." 


* 


Lackof readiness shown, andteacher 
makes corrective responses.) 


(Writes 14 on the board) 
‘“‘Whatis the name of this number ? 
Anybody? Anyone can answer be- 
cause the group is small." 
‘Twenty-four. " x 
**No, Steve, let's begin 
at one and count until 
we reach the number. ” X L(l.i.s) 
DONE MAN PN ËB... TS. 8 
Y Qi ду» 12... 18... 147 
‘Fine, now we know how to pro- 
ceed. "' 
(Not paying attention)  * 
** Polly, look at this num- 
ber right here. You’re 
too busy watching over 
there.How many tens?" X L (n. g.) 
“One.” 
«How many ones?’ 


“One. LEA А Ө 
“Now, ten апа one аге 11 in all. 


Reading to class from Who's Who 
E Supermarket. The Produce De- 


partment is mentioned. ) 

“Do you all know what a Produce 
Department is ? It'sthe namegiv- 
en to the department where fresh 
fruits and vegetables are sold. 

“Name something that is sold inthe 
produce Department. Steve? 

“Lettuce. "' 

“Good. Janie?” 

‘Grapefruit. "' 

“yes. Willy?” 

“Greeners. 

“Greeners? Wha 
Willy?” А 

*Greeners. ” А 

“Could you draw а picture 
of your vegetable? I’m 
afraid we don’t quite un- 
derstand your word. XE (p) 

(Draws on board. His vegetable 


tdo you mean, 


turns out to be a green onion. ) 
“At our house, we call them greeners.’’ 


Findings 


We found that out of a total of 865 behavior epi - 
sodes, 402 were Type A episodes. That is, 46.5% 
of the episodes observed were instances in which 
there was no evidence of lack of readiness on the 
part of learners. Learners indicated alack of read- 
iness in 463 episodes or 53.5% of the total. In 96 
episodes, or 11.1% of the total, teachers made no 
response to the evidence oflack of readiness tolearn 
in that situation (see Table I). 

The average number of episodes recorded in nine- 
teen classes was 46 episodes. The average percent- 
age of Type C episodes was 41% with a standard 
deviation of 15%. 

Type C episodes totaled 367. Of these, 82 epi - 
sodes or 22.3% were episodes in which the teacher 
responded to pupils’ lackof readiness by attempting 
to change something in the environment (E). In 285 
episodes, or 77.7%, the teacher responded to pupils’ 
lack of readiness by attempting tochange something 
about the learner himself. The average percentage 
of learner-directed teacher responses was 76% with 
a standard deviation of 13. 4%. 

Of a total of 82 teacher responses which attempt- 
ed to change something in the environment (E), 53 
responses, or 65%, were a change of procedures; 25 
responses,or 30%, werea change of content; and only 
4 responses, or 5%, were a change of goals (see 
Table II). 

Of a total of 285 teacher responses which attempt- 
ed to change some aspect of the learner’s readiness 
(L), 140 responses, or 49%, sought to change the 
learner’s needs and goals; 138 responses, or 48%, 
to change the pupil’s learned ideas and skills; and 
only 7 responses, or 3%, were related to pupil’ s 
equipment (see Table III). 

The ratio of one sub-category of teacher response 
to the others varied widely among the observed nine- 
teen classes, and no significant central tendency 
was found to exist. 


Conclusions 


A conceptualization of the classroom as an action 
system wherein pupil behavior is viewed as feedback 
information used by teachers to make corrective re- 
sponses is a promising one for the study of the teach- 
ing — learning process. 

The stream of interaction between teacher and 
learners can be divided into episodes and these epi - 
sodes can be classified into three types: 1)Episodes 
in which there is no evidence of lack of readiness on 
the part of the pupils; 2)Episodes in which pupils in- 
dicate a lack of readiness, but in which teachers do 
not respond; 3)Episodes in which pupils indicate lack 


of readiness and in which teachers directly respond 
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TABLE I 


CLASSIFICATION OF BEHAVIOR EPISODES 


Type of Behavior Episode Number Percent 
Type A 402 46.5 
Type B 96) 11.1) 
463 53.5 
Type C 367) 42.4) 
Total 865 100 


TABLE II 


CLASSIFICATION OF ENVIRONMENT-DIREC TED TEACHER RESPONSES (E) 


==  —— o ———FtF 
Aspect of Environment Number Percent 


меН‏ ی و ی ہے ہج ھی کے اہک E‏ م ج چ 


Goals (g) 4 5. 
Content (c) 25 30. 
Procedures (p) 93. 65. 

Total 82 100. 


——————————— =. ы اج‎ 
TABLE III 


CLASSIFICATION OF LEARNER-DIRECTED TEACHER RESPONSES (L) 
=a U RR 


Aspect of Learner's Readiness Number Percent 
Pupil’s equipment (e) 7 3. 
Pupil’s needs and goals 140 49. 
Pupil’s learned ideas and skills(l.i.s.) 138 48 


Total 285 100. 


WAIMON 


to that specific behavior. 

In approximately 40% of the instances observed, 
teachers’ behavior was a direct response to learner 
behavior. This teacher behavior can be classified 
into 1)behavior whichattempts to change the envi- 
ronment to suit the readiness of thelearner (E), or 
2) behavior which attempts to make the learner more 
ready for the environment. Thereisa tendency for 
teachers to try to change the learner’s readiness 
when learning does not occur. 

Teacher responses which manipulate the envi- 
ronment can be classified into the sub-categories 
We used; that is, responses which 1) changed the 
goal, 2)changed the content, 3) changed the proce- 
dures. 

Teacher responses which manipulate the learner 
can be classified into two of the sub-categories 
Which we used; that is, responses which act on 1) 
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pupils’ needs and goals, and 2) pupils’ learned ideas 
and skills. The third category, pupils’ equipment, 
is of questionable value since so few responses went 
into this category. 

The ratio of one sub-category of teacher re- 
sponse to the others varied widely among the nine- 
teen classes, as wehave said. This wide variation 
suggests that type of teacher response may be re- 
lated to some aspect not studied at this time, such 
as, subject matter being taught, grade level being 
taught, or years of teaching experience. 


As a final conclusion, it is felt that direct study 
of the teaching— learning process inactual class - 
rooms by prospective teachers is a valid and advan - 
tageous method ofteachertraining. And, it is fea- 
sible through the use of system analysis and the de- 
velopment of models to help in the conceptualization. 
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RESPONSE PRODUCTIVITY AND 
ACADEMIC SUCCESS?’ 


PETER B. FRED ** 
Philadelphia, Pennsylvania 


THIS STUDY investigates the relation between 
response output and academic criteria. The num- 
ber of responses to screen projections of unstruc- 
tured designs were correlated with first-semester 
grade-point averages of Fall 1960 freshmen. 

The rationale for relating the number of 
responses to academic criteria stems from work on 
а test developed at the Human Engineering Labora- 
tory, called Test 307. Stafford! has made the hy- 
Pothesis that Test 307 measures ''. . - some sort 
Of trait used in making tentative sacrifices for a 
long range goal. . . .°? He found that the median of 
the scores of marriedmen above thirty years of age 
Was higher and significantly different from the me - 
dian of the scores of single men above thirty (р<.09. 

9 significant difference was found between the me- 
dians of single and married men below the age of 
thirty (p>. 25). The lack of significant difference 
between the medians of those below thirty is a con- 
firmation of Stafford’s hypothesis if itis considered 
that men who marry early (i. e. , below thirty), are 
not any more discerning or prudent than single men 


9f the same age group. 

Administration of the Test 

first-semester fresh- 
e University. Of the 
е correlated with the 
e females and 452 


The test was given to 856 
Men at The Pennsylvania Stat 
4 subjects whose scores мег 
Srade-point average, 392 wer 
ere males. 
Initially, a pool of desig 
ed line drawings simil 
Jeet were administered to a 
eli S. The ten designs retain 
o Cited the most responses as 
ie of a sexual nature. 
ed of written instructions pl 
° responses for a design coul 
me he test was one ofa battery © 
ntal tests which were given to fres 


Nem шс eS 


Ац footnotes will be found at end of article. 


ns, which were unstruc - 
ar to those used in Test 
a small number of sub- 
ed were those which 
well as the least as- 
The test paper con- 
us ten lines on which 
d be written. 

f thirteen experi- 
hmen in the 


tur 


fall orientation week. Incoming freshmen were di- 
vided into groups according to the last names. The 
majority of last names of the subjects began with B, 
F, M, or S. Those in the end part of the alphabet 
were tested the first day, and those in the beginning 
were tested the second day. Five other experimental 
tests were included in the battery for these subjects. 
All six tests were given in two- hour blocks. Two 
of these blocks were on Thursday and three were 
on Friday. 

Each design was projected on a large screen for 
a period of one minute. There was a five-second 
interval between each projection. 

Subjects were told to write during the projection 
of the stimulus as many different things that each 
design reminds them of, “looks like or might pos- 
sibly be.” They also were told that they would have 
one minute for each design and that the test would be 
scored only on the total number of different 
responses. 

The responses for each design were totaled to 
give a score for the test. A single concept was 
scored as one response. For example, “circ le 
with cross,” would have been given a score of one. 
Plurals were scored as one response. The grade- 
point average at the university is determined by di- 
viding the grade points by the number of course 
credits. The grade points are found by letting: A - 
4, В = 3, Ç = 2, D = L. 


With three samples, sampled from all sessions , 
each of approximately one hundrgd subjects, the 
odd-even reliability coefficients" were. 89,.91 and 
.94. This finding is not surprising because studies 
on the reliability of Rorschach R (2, 9) agree with 
work done by Mandler and Parnes (5) on 
the consistency of response frequency 
within Ss across stimulus classes. From evidence 
mentioned in the External Analysis section, 
however,it is suspected that the alternate - 
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form or the test-retest reliability of the number of 
responses would be considerably lower. 

From a random sample of 107, taken fromthe 
five sessions, the mean number of responses for the 
females was 37.60 and forthe males it was 35.83. 
These means were not significantly different at the 
. 05 level. 

Since the test was given only to freshmen,the 
range of the subject’s age was highly restricted. 
Nevertheless, the means were obtained for the two 
ages in which most of the Ss fell. With an N of 37, 
the mean number of responses for those aged 17 was 
35.89 and for those aged 18 it was 37.50 (N = 64). 
These means were not significantly different at the 
. 05 level. 


External Analysis 


With 804 subjects the product-moment correla- 
tion between grade-point average and number of re- 
sponses was .19 (p<.05). Although this correlation 
is low, it is not unexpected judging from other stud- 
ies relating Rorschach R with academic Success 
(1, 6, 8). 

Table I presents some unpredicted findings be- 
tween the test sessions. It shows that the correla- 
tions between grade-point aver age and number of 
responses varied from session to session. None of 
these correlation coefficients, however, were sig- 
nificantly different from each other at the . 05 level 
(the largest CR was 1.86). Nevertheless, it was 
found that the correlation of the data from the first 
day was significantly differentfrom the correlation 
of the data from the second day (CR=2.85, p< .05; 
see Table II). 

Table II shows that the means for both grade- 
point average and the number of responses changed 
very little from the first day to the second. It can 
be seen from Table I, however, that the means for 
the five test sessions varied comparatively more. 
Table III shows those means which were signifi- 
cantly different from each other. It is difficult, 
nevertheless, to see any relationship between these 
differences and the differences be tween the corre- 
lation coefficients. Interpreting these differences 
between the means should be cautioned because the 
distribution of responses was found to be skewed. 
Wittenborn (10) reports that the distribution of the 
number of responses to the Rorschach was also 
skewed (positively). To observe the skewness of the 
scores, the medians were computed (see Table IV). 
Unfortunately, they had to be computed from sam- 
ples that were not exactly similar to thosein Table 
J. It can be seen from the differences between the 
means and medians іп Table IV that scores from the 
second day were not considerably more skewed than 
those from the first day. Thus, differences 
between the correlations ofthe five test | Ses- 
sions are probably not related to differencesin the 
skewness of the scores. 


It was hypothesized that the differences ee 
the correlations might be due to the fact that the tests 
were not administered by the same person. Inspec - 
tion of Table I indicates, nevertheless, that the dit 
ferences between the correlationcoefficients are 
not probably a result of examiner bias. ae 

Another possible reason for the difference t 
tween the correlations might bethat subjects sagen 
the second day were less motivated to comply ier 
instructions than subjects who were testedon = 
first day. The second day was a Friday — De ап 
of a long week during which many tests ha ee 
given by the university. Possibly the яше ate 
lost interest in taking tests that had no imme cial 
importance to them. If such were the case, АП, 
data reported by McClelland et al., (7) is ee ер, 
They describe aseries of studies onthe peau. 
tween response output (number of words) under : 
ferent motivation levels for the subjects with a 
moderate, and high n Achievement scores. T i 
conclude that there is a **. . . certain reality Holl 
entation on the part of those with high motiva »É 

." and that their ‘‘. . . response output seer 
on the whole to be relatively high when the situati 


M en 
is achievement related. . .and relatively low ae 
it is not. . .’’ (7:225-26). Their data also a de 


that the response output of those with low anc 
erate n Achievement scores would not vary ! res 
same way as those with high n Achievement Beo 
for different levels of motivation.With the pm T 
that the motivation levels for the two days of s 

were different, the conclusions of McClelland ela” 
provide an explanation for the variation of cor? лае 
tion coefficients with the lack of concomitant var 

tion of either the means or medians. in this 

A somewhat similar situation to the one in s^ 
study has occurred with use of verbal fluency S ent 
ures. Knoell (3) administered six measures Of "ге 
bal fluency to student teachers and found two ge e 
lations with ratings of teaching success to be aga 
-30. Ina follow-up study, she took two full S ad 
periods to administer 20 verbal fluency meas ngs 
and found that most of the correlations with rà tive 
of teaching success were either zero or ipiis 
(4). It must be pointed out, that in addition to а С. 
ference in length of testing periods for the two 5 
les, there was also a difference in the type 0 
ings of teaching success. Therefore, the two 
ies were not exactly comparable. 

As stated earlier, Stafford has made the hy! 
Sis that Test 307 measures “. . . some sor 
trait used in making tentative sacrifices for A ne 
range goal. . . .” To confirm this hypothesis» ре 
mean number of responses was obtained f o 2 he 
Who withdrew (for one reason or another) fr host 
university. Themean number of responses for 


n the 


га 
stud“ 


e- 
poth = 


. 80 
Who withdrew during the first semester oor o0% 
(N=16). The meanof most of the subjects WPO ^ gt 


the test (and who also stayed in college) wae cant 
(N-804). This difference, statistically signi 


FRED 


TABLE I 


CORRELATIONS BETWEEN NUMBER OF RESPONSES AND GPA 
FOR THE FIVE TEST SESSIONS 


Mean 
Time Number Grade- 
of of Point 
Sessions N r Responses Average Examiner 
o MM MEM R 
Thurs. 8AM 129 .26 36.25 2.31 A 
Thurs. 3PM 172 . 30 36. 75 2.21 A 
Fri. 8AM 150 .09 33. 27 2.14 B 
Fri. 1PM 169 .05 38. 06 2.24 A 
Fri 3PM 164 09 35.89 2.21 B 


TABLE II 


CORRELATIONS BETWEEN NUMBER OF RESPONSES AND GPA 
FOR THE TWO TEST DAYS 


Mean 
Number Grade- 
a of b Point 
Day N Ë Responses Average 
Thurs. 301 .28 36. 54 2.14 
Fri. 483 .08 35.84 2.22 


significantly different at .05 level (CR-2. 85). 


a 
These correlation coefficients were 
fferent at . 05 level (t =0. 75). 


b These means were not significantly di 
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TABLE III 


THE MEANS FOR THE FIVE TEST SESSIONS WHICH WERE 
SIGNIFICANTLY DIFFERENT FROM EACH OTHER 


Time Time 
of of 
Sessions Mean Sessions Mean Diff. t p 
Thurs. 3PM 36.75 Fri. 8AM 33.27 3.49 2.18 ‚05 
Fri. 1PM 38.06 Fri. 8AM 33.27 4.79 3.47 .01 
TABLE IV 


DIFFERENCES BETWEEN THE MEAN AND MEDIAN 
FOR THE FIVE TEST SESSIONS 


—————-—————————ӱ———_—___________________ 


Time 


Difference 
of between 
Sessions N Mean Median Mean and Median 
Thurs. 8AM 117 36. 82 34.72 2.10 
Thurs. 3PM 171 36. 68 34. 37 2.31 
Fri. 8AM 137 32.47 33. 66 1.19 
Fri. 1PM 190 31.81 34. 50 3.31 
Fri. 3PM 177 36.12 33. 60 2.25 


Note: The samples are not exactly the same as those in Table I or Table III. 


is an indication that the number of responses meas- 
ures some trait to make sacrifices for a long range 
goal. The mean for those who withdrew after their 
first-semester finals was 39. 28 (N-21). 

Another unexpected result was that the response 
frequency for those who failed to put their student 
numbers on the test paper (requested for identifica - 
tion purposes) correlated .42 with grade-point av - 
erage (p<.01). With the present lack of knowledge 
of what the number of responses measures, thi s 
outcome is difficult to interpret. 


Conclusions 


The results give only slight clarification of the 


"usefulness of the number of responses for predict- 


ing academic criteria. They are more important as 
indications of what should be done with the test in 
the future. For instance, further researchis needed 
to determine thetype of instructions which produces 
the highest correlation between the number of re- 
sponses and grade-point average. Because the cor- 
relation coefficients were not the same for both days 
of testing, the test-retest or alternate-form relia- 
bility of the number of responses also should be re- 
examined. 


Summary 


The number of responses to ten screen projec- 
tions of unstructured designs was correlated with 
first-semester grade-point averages of Fall 1960 
freshmen. It was found that for atotal N of 804 the 
correlation coefficient was .19. However, it was 
also observed that the correlation of the data from 
those tested the first day (. 28) was significantly dif- 
ferent from the correlation of the data from those 
tested the second day (. 08). Interpretations of this 
finding were offered. The mean number of re- 
sponses of those who dropped from the university 
during the first semester was found to be lower than 
the mean of all those tested and of those who with- 
drew by not registering for the second semester. 
Also, a correlation coefficient of . 42 was found be- 
tween response output and grade-point average for 
all those who failed(contrary to instructions) to put 
their student number on the test paper. 


FOOTNOTES 


senior thesis un- 


* 1 
This study was undertaken asa 
hard E. Stafford. 


der the supervisionof Mr. Ric 


FRED 


365 


The writer is indebted to Student Affairs 
Research at The Pennsylvania State University 
for making its test data and records available. 


** 254 South 38th Street, Philadelphia 4, Pennsyl- 
vania. 


l bersonal communication April, 1961. 


2 Reliability coefficient of whole test, extrapolated 
by the Spearman- Brown formula from the corre- 
lation between odd and even halves. 
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THE ACCURACY OF STUDENTS’ JUDGMENTS 
OF THEIR TEACHER’S OPINIONS 


* 


LAWRENCE S. WRIGHTSMAN, Jr. 
George Peabody College for Teachers 


THE PURPOSE of this study is to determine if 
certain characteristics of elementary-school pupils 
contribute to the accuracy of their understanding of 
their teacher’s opinions. Although the concept of 
interpersonal perception has generated much re- 
search in recent years, little of it has been applied 
to classroom situations. And though researchers 
and educators have been concerned much of late 
Over the teacher variables which contribute toa de- 


sirable teacher-student relationship, we have ig- - 


nored the student variables. This study attempts 
to shed some light on these. 

What might be theorized as the qualities in a stu- 
dent which would cause him to estimate his teach- 
er's opinions more accurately? One of these is 
high intelligence. Reviews of researchon interper- 
Sonal perception (2, 7) indicate that a person’s ac- 
curacy level is usually related to his IQ. Most 
studies have used adult subjects, butone, by Miller 
(6), was directed toward interpersonal perception 
in elementary school children. Those children su - 
perior in intelligence were found to be better judges 
of other pupils’ sociometric status, while retarded 
children (in the same classes) were found to be the 
poorest. But thelevelof intelligence was also pos- 
itively related to sociometric status, and the latter 
could have been the determining variable in the 
above relationship. No study seems tohave focused 
On relating intelligence level to accuracy inthe pre- 
diction of teachers' opinions. | 

It intelligence is related to the accuracy of inter - 
Personal perception, it should follow that level of 
achievement will be also, as the two are usually 
highly correlated. One study (4) indicates that 
achievement in college students, as measured by 
their honor point ratios, is related to their accuracy 
In estimating roommates’ responses to a person- 
ality inventory (r of +. 37, significant at . 01 level). 

rom this finding, Chambers (4), making the as - 


—— EL 


* 
The assistance of the eighth-grade teacher 
acknowledged. 


sumption that accuracy in interpersonal perception 
is a generalized ability, concludes that itis adeter- 
minant which contributes to scholastic achievement 
even after the effects of intelligence have been par - 
tialled out. He finds apartial correlation between 
accuracy and honor point ratio of +. 35, after con - 
trolling for the effects of intelligence, and con- 
cludes that ‘‘empathy (or interpersonal perception) 
evidently is the different quality which enables the 
student to have scholastic success in spite of low 
scholastic aptitude’’ (4:284). Such a finding gives 
some credence to the idea that there is some gener- 
alizability of skill in interpersonal perception. 


Chambers’ study seem s to indicate that some 
cases of over-achievement may occur partially be- 
cause of the perceptiveness of the student and his 
ability to apply what he has learned to the task of im- 
pressing his teacher. Thehighly motivated student 
who realizes that his teacher represents a signifi- 
cant determiner of his level of success thus notices 
things about his teacher which the less motivated 
student might miss. Grosbeck’s study (5) of gradu- 
ate students in Clinical Psychology gives further 
credence to this idea (that over-achievement should 
be related to accuracy of perception of the teacher’s 
attitudes). 


Lastly, as a different kind of contribution to ac- 
curacy, is the similarity inattitude between student 
and teacher. It has been well demonstrated that one 
of the causes of accuracy is simply similarity, for 
all of us to some degree tend to project our own at - 
titudes upon others (2, 7). 


It is then hypothesized that the following varia- 
bles will be related to the accuracy of students’ per- 
ceptions of their teacher's opinions: high intelli- 
gence, high achievement, over-achievement, and 
similarity of opinion with the teacher. 


sin the Murfreesboro, Tennessee, public schools is gratefully 
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TABLE І 


CORRELATIONS BETWEEN ACCURACY AND OTHER MEASURES 


r between 
r between Accuracy and r between r between 
N of Accuracy and Achievement Accuracy Accuracy and 
Teacher School Pupils Intelligence Test Level and Grades Similarity 
Mr. A 1 25 . 24 . 26 -.03 24 
** v". * e 
Mrs. B 1 20 .94 55 .42 .68 
* * + 
Mrs. C 2 21 .45 .40 Л .97 
Mrs. D 2 19 .60** E -.20 .29 
Mr. E 3 28 . 62" .49"* .50** Jie 
Mrs. F 3 10 s 16 -.07 . 38 .95 
Miss G 4 23 .05 .00 289 .65** 
146 
* Significantly different from . 00 at .05 level. 
** Significantly different from .00 at . 01 level. 
TABLE II 
MEAN ACCURACY AND SIMILARITY SCORES FOR UNDER- ACHIEVERS, 
EXPECTED ACHIEVERS, AND OVER-ACHIEVERS 
Mean Mean 
Accuracy Similarity 
Score Score 
Under-achievers 25 15.2 15.5 
Expected achievers 82 13.7 14.9 
Over-achievers 39 13.6 15.0 
146 
TABLE HI 
PARTIAL CORRELATIONS BETWEEN ACCURACY AND OTHER MEASURES 
WITH EFFECTS OF SIMILARITY PARTIALLED OUT 
r between 
r between Accuracy and r between 
N of Accuracy and Achievement Accuracy 
Teacher Pupils Intelligence Test Score and Grades 
Mr. A 25 aT .20 " 
Mrs. B 20 45 38* 29 
Mrs. C 21 28 47 09 
А à 
Mrs. D 19 . 44 45" 35 
Mrs. E 28 A; яй ag 
Mrs. F 10 -.33 si 02 
Miss G 23 -,88* 
136 07 -.23 


% Significantly different from .00 at .05 level. 


** Significantly different from . 00 at . 01 level. 
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Method 


The subjects of this study were pupils in the 
seven-eight grade classes inthe public schools of a 
small Southern city. Six of the classes were white 
and one was Negro. Students in a particular class 
had the same teacher throughout the day, except for 
instruction in a few special subjects such as Music 
and Physical Education. 

Late in the school year the subjects were asked 
to indicate their agreement on each of thirty opinion 
items. Then they were asked to indicate how they 
thought their teacher would respond. Eighteen of 
these items dealt with the kinds of things on which 


<. the teacher could conceivably have expressed his or 


her opinion to the class (the propriety of chewing 
gum in public, thedesirability of a college educa - 
tion for everybody, etc.), while the other 12 were 
simplified versions of items from the California F 
Scale (1). The students were told that the teacher 
would never see their answers. Todetermine each 
student's accuracy and his similarity to his teach- 
er, his own answers and his expectation for the 
teacher's answer were compared with the actual 
answers of his teacher, who filled out the form in 
another room at the same time that the class did. 
The students’ scores on the Sequential Tests of 
Educational Progress (STEP) and the School and 
College Ability Tests (SCAT), taken earlier in the 
year, were available, and course grades were ob- 
tained at the end of the school year. Scores on all 
the measures of this study were available for 146 
of the approximately 180 students in the eighth- 


grade classes. 


Results and Discussion 


Since eachclass hada different teacher to judge, 
classes were analyzed separately. Re sults for 
each variable hypothesized to be related to accu- 
racy Will be considered separately below. 


Level of intelligence. When the SCAT scores 
were used as a measure of intelligence, the stu- 
dents’ intelligence was found to be significantly re- 
lated to their accuracy in four of the classes. AS 
can be seen in Table I, in four of the classes cor- 
relations were between +. 45 and +. 62, indicating 
moderate relationship between the students’ IQs 
and their awareness of their teacher's attitudes. In 
the other three classes, correlations were low and 
non-significant, although in all cases positive. We 
may conclude that for a majority of the samples, 
the more intelligent students possess a greater 
Awareness of their teacher’s attitudes. 


Achievement-level. Achievement lev el was 
. Measured by performance on the STEP achievement 


‘test and by grade-point-ratio. (Since the STEP 
Оез not give atotal score, standard scores onthe 


i 


several achievement areas were averaged for each 
student.) As may be noted in Table I, for the same 
four classes as beforethere was a significant posi- 
tive relationship between accuracy and achievement 
test score. In the case of the relationship between 
grades and accuracy, in only two of these four 
classes was the relationship significant. This may 
be due to the lack of variability in honor-point- ratios 
or to the lesser validity of the grades, as compared 
with achievement-test scores, asa measure of 
achievement. 


Over-achievement. Extent of over-achievement 
or under-achievement was determined by compar- 
ing the students’ STEP and SCAT scores. If a ma- 
jority of his STEP scores were beyond the band for 
his SCAT total score, he was categorized as an 
over- or under-achiever. Table II presents the 
mean accuracy scores for over- and under-achiev- 
ers. Analysis of variance indicated that neither 
group differed from the normalachieversinthe ac - 
curacy of their awareness of their teacher's atti - 
tudes. The hypothesis that over-achieving students 
would be more accurate judges of their teacher's 
opinions was rejected. 


Similarity. As may beseenin Table I, the tend - 
ency for subjects similar tothe object person to be 
more accurate was borne outsignificantly in five of 
the seven classes. This finding is so pervasive in 
interpersonal perception research that it makes us 
question the negative findings іп the other two class- 
es. It may be seenthat in Mr. A’sclass there were 
no significant relationships with accuracy. One 
might assume that the negative findings in this class 
might be due to the fact that the teacher either did 
not reveal his attitudes at all to the class or that he 
answered the questionnaire differently from what 
his classroom behavior had indicated to the students. 
However, accuracy scores for students in this class 
were just as high as for the other classes, so the 
lack of relationship must rest insome other reason. 
Nevertheless, this opportunity should be taken to 
point out one of the risks in research such as this. 
We are basing our conclusion on the judgments about 
one object person, and as Brunswik (3) has pointed 
out, this is about as lacking in generalizability as 
are the results based on one subject. 

The generally high correlations between 
accuracy and similarity cause us to wonder if all the 
above significant results can simply be explained by 
similarity (i.e., that intelligent students are more 
similar to the teacher in attitude and hence more 
accurate, that high achievers are more similar, and 
so on). Inan attempt to determine this, partial cor- 
relations, controlling for the effect of similarity, 
were calculated. Table III presents these. It may 
be seen that eight of the 10 previously significant 
relationships maintain their significance, although 
in some cases the significance level has :dropped 
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from .01 to .05. It was concluded that the increased 
accuracy of brighter and higher-achieving students 
could not be fully explained by their greater simi - 
larity to the teacher. Intelligence and achieve- 
ment level make their own contributions toa greater 
awareness of the teacher’s attitudes. 


Summary 


The following characteristics of students were 
hypothesized to be related to the accuracy of their 
estimates of their teacher’s opinions; high intelli- 
gence, high level of achievement, high grades, 
similarity of opinion with the teacher, and over- 
achievement. All but the last were found to be 
significantly positively related to accuracy, using 
146 eighth-grade students inthe seven classes of a 
small school system as subjects. Partial corre- 
lations indicated that most of the relationship still 
existed after the effects of similarity had been re- 
moved. 


REFERENCES 


1. Adorne, T. W., Frenkel-Brunswik, E., Levin- 


son,D.J., and Sanford, N. The Authoritar- 
ian Personality (New York: Harper an 
Brothers, 1950). š 
Bruner,J., and Tagiuri, R. ‘‘The Perception 
of People," inG. Lindzey (Ed.), Handbook 
of Social Psychology (Cambridge, Mass. : 
‘Addison-Wesley, 1954). » 
Brunswik, E. Systematic and Representative 
Design of Psychological Experiments, wit h 
Results in Physical and Social Perception 
(Berkeley: University of California Press, 
1947). "m 
Chambers, F.M. “Empathy and Scholastic 
Success," Personnel and Guidance Journal, 
XXXVI (1987), pp. 282-284. N 
Grosbeck, B. L. ‘‘TowardDescription of Per- 
sonality in Terms of Configuration of Mo- 
tives,” in J.W. Atkinson (Ed.), Motives іп 
Fantasy, Action, and Society (Princeton 
N.J.: Van Nostrand, 1958). - | 
Miller, R.V. “Social Status and Socio “ 
empathic Differences among Mentally Supe” 
rior, Mentally Typical, and Mentally Re- 
tarded Children,” Exceptional Chil dren, 
XXIII (1956), pp. 114-119. M 
Taft, R. ** The Ability to Judge People; 
Psychological Bulletin, Ш (1955), рр. 17? 


B 


n 


4 


Г 
LES 
Ja" 


#* 


